-- Logs begin at Mon 2022-08-08 12:52:07 UTC, end at Mon 2022-08-08 14:03:20 UTC. -- Aug 08 13:26:47.381991 dv-cinder-851996-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 13:26:47.393181 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 13:26:47 2022] *** Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: nodename: dv-cinder-851996-6-iscsi Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: machine: x86_64 Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: clock source: unix Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: pcre jit disabled Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: detected number of CPU cores: 4 Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: current working directory: / Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: detected binary path: /usr/bin/uwsgi-core Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: your processes number limit is 47680 Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: your memory page size is 4096 bytes Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: detected max file descriptor number: 2048 Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: lock engine: pthread robust mutexes Aug 08 13:26:47.393764 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: thunder lock: enabled Aug 08 13:26:47.394907 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 13:26:47.394907 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 13:26:47.432788 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: Python main interpreter initialized at 0x56367d47f9c0 Aug 08 13:26:47.432788 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: python threads support enabled Aug 08 13:26:47.432788 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: your server socket listen backlog is limited to 100 connections Aug 08 13:26:47.432788 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: your mercy for graceful operations on workers is 90 seconds Aug 08 13:26:47.433234 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 13:26:47.433234 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: *** Operational MODE: preforking *** Aug 08 13:26:47.433493 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: *** uWSGI is running in multiple interpreter mode *** Aug 08 13:26:47.433493 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: spawned uWSGI master process (pid: 103424) Aug 08 13:26:47.433811 dv-cinder-851996-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 13:26:47.434348 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: spawned uWSGI worker 1 (pid: 103425, cores: 1) Aug 08 13:26:47.434678 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: spawned uWSGI worker 2 (pid: 103426, cores: 1) Aug 08 13:26:47.434837 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 13:26:48.099124 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 13:26:48.116389 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 13:26:49.180821 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 13:26:49.180821 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: from cryptography.utils import int_from_bytes Aug 08 13:26:49.181537 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 13:26:49.181537 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: from cryptography.utils import int_from_bytes Aug 08 13:26:49.182301 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 13:26:49.182301 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: from cryptography.utils import int_from_bytes Aug 08 13:26:49.182734 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 13:26:49.182734 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: from cryptography.utils import int_from_bytes Aug 08 13:26:51.642246 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 13:26:51.642821 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 13:26:51.642913 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 13:26:51.642913 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 13:26:51.643466 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 13:26:51.643466 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 13:26:51.643601 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 13:26:51.643682 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 13:26:51.643755 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 13:26:51.643927 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.644011 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 13:26:51.644261 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.644408 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.644584 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.644715 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.644897 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.645030 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.645222 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.645369 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.645541 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.645667 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.645812 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.645921 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.646173 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.646306 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.646481 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.646623 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.646721 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.646818 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.647031 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.647206 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.647379 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-6-iscsi {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.647511 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.647698 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.647853 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-6-iscsi {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.648016 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.648102 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.648298 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.648475 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.648574 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.648797 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.648889 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.649181 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.649277 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.649484 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.649577 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.649837 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.649982 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.650398 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.650527 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.650633 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.650766 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.650933 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.651048 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.651278 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.651391 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.651531 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.651826 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.651941 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.652264 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.652397 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.652520 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.652675 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.652807 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.652979 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.653074 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.653307 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.653398 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.653612 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.653706 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.654040 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-6-iscsi {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.654148 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-6-iscsi {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.654354 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.654445 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.654666 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.654797 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.654974 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.655065 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.655422 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.655541 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.655732 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.655867 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.656039 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.656130 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.656354 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.656454 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.656669 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.656761 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.656977 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.657068 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.657298 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.657400 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.658601 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.658813 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.658813 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.659159 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.659763 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.659877 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.659877 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.660028 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.660028 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.660186 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.660512 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661006 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661102 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661184 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661263 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661343 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661343 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661507 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661598 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661678 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661757 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661842 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.661932 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662013 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662099 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662184 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662272 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662364 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662455 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662543 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662679 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662773 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662855 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.662948 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.663037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.663149 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.663238 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.663319 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.663407 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.663537 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.663626 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.663772 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.663949 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.664072 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.664251 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.664391 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.664554 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.664699 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.664854 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.665006 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.665157 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.665310 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.665468 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.665632 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.665764 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.665931 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.666081 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.666255 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.666386 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.666564 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.666704 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.666884 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.667114 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.667309 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.667409 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.667560 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.667654 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.667947 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.668064 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.668294 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.668390 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.668613 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.668710 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.668920 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.669009 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.669240 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.669327 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.669561 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.669662 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.669864 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.669956 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.670169 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.670270 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.670477 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.670573 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.670796 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.670884 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.671168 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.671258 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.671373 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.671471 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.671674 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.671769 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.671972 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.672058 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.672278 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.672450 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.672577 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.672681 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.672878 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.672976 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.673179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.673275 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.673495 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.673583 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.673779 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.673865 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.674078 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.674173 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.674379 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.674473 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.674679 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.674774 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.674979 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.675067 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.675303 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.675407 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.675611 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.675698 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.675909 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.675997 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.676209 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.676298 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.676509 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.676604 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.676823 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.676909 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.677125 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.677219 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.677425 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.677523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.677727 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.677826 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.678027 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.678115 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.678332 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.678426 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.678630 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.678717 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.678931 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.679018 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.679260 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.679347 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.679571 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.679658 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.679872 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.679959 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.680174 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.680259 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.680473 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.680559 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.680774 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.680869 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.681081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.681181 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.681379 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.681465 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.681677 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.681765 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.681982 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.682076 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.682278 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.682364 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.682579 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.682665 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.682880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.682976 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.683205 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.683299 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.683531 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.683619 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.683833 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.683927 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.684131 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.684218 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.684428 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.684513 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.684720 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.684818 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.685016 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.685114 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.685331 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.685418 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.685634 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.685721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.685935 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.686023 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.686235 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.686329 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.686538 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.686624 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.686856 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:26:51.686951 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.687205 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.687305 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.687538 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.687628 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.687846 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.687937 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.688176 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.688279 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.688506 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.688592 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.688820 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.688907 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.689128 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.689226 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.689437 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.689524 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.689754 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.689841 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.690057 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.690152 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.690364 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.690490 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.690672 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.690774 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.690983 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.691070 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.691324 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.691411 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.691642 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.691738 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.691953 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.692048 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.692263 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.692352 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.692574 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.692663 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.692879 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.693090 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.693177 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.693256 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.693490 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.693580 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.693808 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.693903 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.694115 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.694211 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.694423 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.694511 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.694763 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.694852 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.695070 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.695197 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.695412 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.695508 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.695733 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.695837 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.696041 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.696129 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.696348 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.696434 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.696654 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.696755 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.696974 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.697062 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.697294 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.697393 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.697603 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.697689 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.697918 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.698005 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.698226 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.698325 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.698535 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.698623 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.698840 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.698935 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.699277 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.699384 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.699595 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.699683 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.699909 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.700003 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.700232 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.700332 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.700549 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.700663 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.700864 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.700987 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.701178 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.701305 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.701491 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.701627 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.701803 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.701945 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.702113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.702260 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.702416 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.702575 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.702721 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.702882 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.703023 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.703215 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.703361 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.703524 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.703667 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.703836 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.703985 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.704143 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.704310 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.704465 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.704613 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.704794 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.704944 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.705101 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.705246 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.705434 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.705552 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.705758 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.705857 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.706070 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.706165 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.706381 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.706475 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.706692 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.706787 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.707002 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.707127 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.707342 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.707441 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.707656 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.707745 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.707962 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.708060 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.708267 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.708354 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.708582 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.708708 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.708882 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.709015 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.709184 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.709282 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.709496 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.709584 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.709801 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.709889 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.710107 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.710203 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.710419 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.710505 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.710726 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.710818 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.711037 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.711202 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.711370 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.711456 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.711679 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.711774 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.711997 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.712133 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.712314 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.712410 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.712619 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.712705 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.712942 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.713032 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.713261 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.713347 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.713574 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.713668 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.713878 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.713980 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.714185 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.714281 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.714490 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.714595 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.714821 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.714910 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.715148 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.715239 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.715456 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.715553 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.715759 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.715845 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.716064 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.716150 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.716367 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.716467 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.716672 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.716759 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.716976 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.717062 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.717284 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.717381 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.717590 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.717675 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.717895 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.717988 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.718198 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.718294 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.718500 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.718587 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.718804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.718889 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.719133 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.719223 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.719479 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.719577 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.719786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.719873 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.720117 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.720203 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.720438 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.720532 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.720749 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.720837 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.721065 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.721160 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.721375 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.721462 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.721685 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.721771 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.721994 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.722084 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.722305 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.722391 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.722616 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.722700 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.722925 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.723012 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.723272 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.723373 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.723583 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.723677 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.723903 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.723989 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.724211 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.724296 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.724529 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.724630 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.724833 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.724928 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.725153 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.725248 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.725458 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.725557 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.725780 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.725867 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.726119 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.726205 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.726437 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.726533 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.726746 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.726836 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.727059 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.727216 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.727392 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.727488 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.727705 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.727790 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.728013 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.728103 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.728323 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.728411 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.728633 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.728719 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.728940 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.729025 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.729260 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.729354 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.729566 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.729652 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.729884 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.729969 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.730207 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.730342 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.730558 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.730647 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.730862 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.730959 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.731198 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.731291 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.731504 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.731589 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.731819 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.731919 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.732144 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.732238 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.732456 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.732543 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.732770 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.732866 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.733078 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.733164 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.733392 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.733479 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.733701 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.733800 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.734005 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.734091 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.734311 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.734397 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.734614 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.734710 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.734920 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.735015 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.735249 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.735337 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.735559 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.735648 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.735860 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.735947 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.736167 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.736252 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.736473 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.736562 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.736774 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.736862 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.737077 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.737164 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.737379 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.737475 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.737682 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.737815 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.737988 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.738074 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.738305 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.738392 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.738616 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.738703 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.738920 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.739051 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.739247 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.739337 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.739555 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.739641 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.739860 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.739955 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.740164 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.740253 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.740468 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.740563 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.740769 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.740865 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.741070 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.741158 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.741374 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.741461 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.741687 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.741787 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.742001 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.742088 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.742301 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.742386 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.742613 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.742701 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.742924 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.743017 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.743253 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.743341 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.743560 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.743648 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.743867 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.743955 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.744175 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.744262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.744480 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.744574 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.744789 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.744884 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.745094 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.745187 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.745401 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.745487 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.745708 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.745801 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.746044 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.746140 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.746349 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.746449 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.746656 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.746744 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.746964 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.747062 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.747291 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.747378 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.747599 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.747686 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.748261 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.748364 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.748570 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.748837 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.748932 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.749168 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.749444 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.749541 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.749781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.749867 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.750098 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.750184 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.750412 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.750499 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.750732 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.750817 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.751052 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.751213 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.751409 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.751498 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.751714 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.751810 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.752025 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.752121 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.752352 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.752486 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.752626 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.752726 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.752936 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.753024 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.753241 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.753328 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.753542 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.753630 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.753847 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.753932 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.754151 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.754246 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.754451 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.754538 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.754752 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.754846 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.755052 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.755211 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.755375 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.755472 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.755684 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.755780 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.755986 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.756074 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.756294 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.756383 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.756595 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.756681 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.756909 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.756997 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.757213 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.757301 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.757510 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.757595 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.757810 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.757905 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.758112 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.758206 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.758412 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.758501 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.758718 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.758815 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.759055 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.759214 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.759405 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.759496 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.759744 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.759841 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.760047 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.760135 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.760349 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.760435 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.760670 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.760767 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.760972 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.761067 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.761272 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.761366 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.761620 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.761714 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.761928 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.762015 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.762233 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.762319 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.762533 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.762659 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.762838 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.762932 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.763169 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.763260 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.763479 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.763624 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.763788 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.763877 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.764083 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.764183 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.764388 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.764475 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.764688 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.764783 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.764995 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.765096 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.765298 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.765385 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.765596 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.765685 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.765892 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.765988 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.766198 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.766286 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.766498 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.766585 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.766796 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.766896 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.767120 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.767210 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.767424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.767512 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.767731 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.767820 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.768032 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.768118 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.768331 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.768418 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.768630 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.768732 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.768936 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.769024 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.769240 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.769321 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.769541 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.769629 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.769847 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.769973 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.770151 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.770239 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.770449 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.770544 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.770747 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.770841 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.771053 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.771189 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.771375 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.771463 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.771678 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.771765 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.771984 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.772080 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.772288 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.772386 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.772596 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.772683 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.772899 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.772994 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.773213 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.773308 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.773516 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.773605 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.773818 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.773917 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.774122 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.774210 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.774421 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.774506 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.774723 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.774811 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.775024 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.775142 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.775352 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.775439 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.775660 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.775760 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.775963 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.776050 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.776272 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.776368 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.776578 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.776667 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.776878 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.776963 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.777205 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.777299 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.777510 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.777600 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.777813 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.777899 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.778117 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.778214 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.778459 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.778560 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.778762 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.778850 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.779072 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.779192 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.779412 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.779500 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.779725 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.779812 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.780034 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.780129 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.780344 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.780430 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.780645 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.780730 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.780955 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.781050 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.781259 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.781356 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.781572 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.781672 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.781869 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.781966 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.782170 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.782257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.782472 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.782570 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.782775 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.782864 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.783126 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.783217 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.783417 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.783504 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.783729 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.783818 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.784047 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.784133 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.784349 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.784443 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.784654 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.784744 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.784961 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.785049 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.785269 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.785354 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.785571 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.785666 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.785875 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.785962 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.786181 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.786286 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.786487 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.786581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.786794 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.786887 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.787117 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.787225 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.787427 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.787514 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.787728 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.787815 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.788032 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.788128 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.788336 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.788422 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.788635 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.788720 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.788942 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.789038 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.789244 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.789330 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.789544 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.789639 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.789847 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.789936 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.790146 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.790233 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.790452 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.790574 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.790750 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.790840 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.791060 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.791185 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.791387 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.791496 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.791802 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.791889 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.792104 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.792190 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.792408 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.792502 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.792751 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.792855 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.793065 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.793156 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.793377 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.793475 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.793679 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.793765 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.793991 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.794089 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.794293 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.794389 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.794676 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.794770 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.794986 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.795095 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.795315 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.795416 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.795617 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.795704 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.795923 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.796009 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.796223 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.796318 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.796535 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.796629 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.796834 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.796921 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.797135 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.797230 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.797437 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.797523 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.797738 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.797823 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.798053 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.798141 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.798353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.798462 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.798671 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.798758 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.799063 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.799195 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.799415 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.799504 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.799724 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.799813 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.800082 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.800170 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.800402 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.800491 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.800719 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.800814 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.801037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.801133 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.801338 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.801427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.801648 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.801759 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.801953 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.802050 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.802268 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.802355 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.802579 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.802666 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.802881 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.802975 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.803218 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.803309 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.803523 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.803623 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.803833 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.803928 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.804139 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.804226 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.804444 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.804529 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.804761 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.804858 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.805071 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.805158 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.805392 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.805479 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.805766 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.805853 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.806085 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.806172 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.806407 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.806494 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.806709 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.806797 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.807009 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.807136 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.807347 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.807483 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.807648 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.807738 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.807950 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.808038 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.808255 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.808409 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.808635 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.808784 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.808934 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.809102 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.809242 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.809413 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.809556 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.809720 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.809867 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.810025 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.810177 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.810328 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.810481 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.810649 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.810786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.810951 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.811134 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.811303 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.811441 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.811614 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.811763 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.811932 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.812077 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.812249 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.812398 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.812552 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.812717 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.812873 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.813027 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.813184 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.813350 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.813486 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.813661 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.813788 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.813968 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.814086 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.814272 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.814422 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.814577 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.814725 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.814920 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.815043 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.815278 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.815396 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.815608 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.815723 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.815939 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.816028 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.816268 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.816356 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.816581 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.816676 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.816914 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.817014 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.817242 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.817329 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.817560 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.817660 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.817861 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.817953 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.818161 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.818249 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.818468 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.818564 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.818770 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.818864 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.819071 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.819179 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.819393 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.819499 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.819704 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.819829 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.820001 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.820089 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.820308 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.820405 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.820610 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.820696 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.820911 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.820997 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.821214 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.821304 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.821531 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.821617 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.821832 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.821919 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.822133 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.822224 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.822434 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.822529 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.822734 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.822821 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.823038 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.823170 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.823367 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.823470 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.823705 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.823805 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.824039 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.824143 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.824359 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.824449 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.824674 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.824775 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.824986 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.825075 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.825298 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.825394 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.825610 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.825707 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.825921 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.826008 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.826232 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.826319 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.826545 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.826647 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.826852 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.826948 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.827187 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.827278 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.827500 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.827588 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.827816 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.827901 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.828134 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.828337 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.828500 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.828663 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.828965 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.829060 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.829273 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.829361 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.829582 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.829677 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.829891 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.829978 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.830200 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.830296 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.830509 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.830604 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.830818 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.830914 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.831145 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.831253 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.831456 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.831545 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.831767 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.831862 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.832081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.832181 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.832401 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.832495 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.832725 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.832811 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.833036 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.833124 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.833351 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.833446 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.833662 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.833749 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.833974 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.834062 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.834286 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.834372 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.834601 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.834702 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.834918 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.835005 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.835269 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.835375 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.835583 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.835684 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.835894 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.835988 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.836201 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.836288 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.836507 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.836603 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.836815 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.836903 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.837124 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.837214 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.837431 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.837521 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.837737 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.837824 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.838045 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.838139 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.838358 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.838448 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.838666 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.838760 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.838980 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.839109 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.839326 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.839427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.839693 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.839791 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.840002 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.840101 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.840312 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.840401 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.840626 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.840831 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.840943 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.841147 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.841463 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.841560 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.841779 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.841867 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.842098 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.842197 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.842413 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.842501 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.842728 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.842816 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.843045 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.843179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.843378 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.843511 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.843682 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.843771 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.843992 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.844081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.844298 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.844387 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.844601 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.844688 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.844908 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.844996 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.845214 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.845308 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.845513 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.845600 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.845831 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.845920 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.846136 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.846223 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.846456 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.846662 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.846758 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.847010 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.847314 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.847418 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.847659 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.847755 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.847980 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.848066 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.848292 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.848378 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.848597 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.848695 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.848932 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.849028 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.849219 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.849306 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.849521 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.849629 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.849834 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.849922 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.850140 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.850227 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.850441 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.850530 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.850742 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.850830 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.851050 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.851196 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.851381 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.851471 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.851683 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.851771 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.851990 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.852078 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.852291 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.852380 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.852600 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.852691 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.852905 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.852990 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.853211 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.853300 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.853513 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.853600 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.853821 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.853922 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.854121 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.854209 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.854422 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.854512 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.854724 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.854824 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.855024 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.855144 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.855382 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.855480 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.855684 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.855781 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.855990 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.856088 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.856290 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.856379 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.856596 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.856691 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.856894 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.856983 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.857200 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.857289 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.857500 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.857665 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.857807 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.857894 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.858113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.858207 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.858435 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.858524 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.858741 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.858828 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.859061 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.859170 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.859404 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.859493 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.859712 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.859799 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.860017 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.860104 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.860336 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.860423 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.860650 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.860744 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.860995 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.861194 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.861312 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.861524 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.861838 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.861932 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.862170 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.862267 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.862490 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.862577 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.862793 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.862878 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.863114 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.863217 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.863423 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.863511 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.863746 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.863833 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.864056 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.864153 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.864365 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.864454 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.864673 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.864807 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.864981 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.865071 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.865292 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.865380 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.865599 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.865684 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.865907 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.865995 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.866211 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.866298 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.866517 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.866613 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.866822 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.866911 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.867149 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.867240 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.867459 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.867564 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.867763 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.867850 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.868066 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.868161 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.868371 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.868466 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.868678 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.868767 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.868992 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.869080 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.869308 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.869409 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.869620 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.869709 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.869932 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.870081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.870238 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.870369 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.870542 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.870632 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.870880 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.870987 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.871235 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.871337 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.871549 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.871645 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.871860 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.871947 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.872174 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.872262 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.872476 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.872572 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.873157 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.873259 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.873469 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.873557 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.873857 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.873942 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.874175 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.874271 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.874482 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.874571 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.874802 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.874932 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.875140 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.875245 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.875440 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.875527 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.875760 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.875858 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.876069 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.876166 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.876388 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.876475 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.876700 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.876789 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.877028 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.877117 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.877348 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.877442 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.877651 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.877740 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.877955 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.878044 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.878256 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.878344 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.878563 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.878651 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.878878 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.878966 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.879205 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.879293 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.879509 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.879608 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.879811 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.879935 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.880114 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.880209 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.880412 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.880514 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.880716 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.880804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.881016 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.881103 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.881316 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.881412 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.881619 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.881713 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.881919 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.882006 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.882224 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.882323 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.882524 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.882610 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.882823 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.882911 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.883146 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.883238 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.883448 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.883537 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.883748 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.883835 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.884046 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.884141 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.884348 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.884435 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.884647 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.884733 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.884946 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.885033 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.885245 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.885333 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.885552 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.885639 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.885853 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.885942 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.886181 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.886268 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.886524 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.886698 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.886835 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.886924 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.887174 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.887264 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.887484 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.887590 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.887814 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.887907 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.888108 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.888195 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.888419 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.888515 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.888727 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.888815 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.889039 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.889125 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.889350 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.889446 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.889656 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.889742 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.889964 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.890050 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.890272 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.890361 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.890593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.890683 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.890886 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.890973 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.891217 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.891309 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.891529 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.891616 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.891832 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.891963 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.892152 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.892241 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.892510 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.892614 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.892772 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.892869 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.893085 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.893181 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.893396 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.893485 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.893713 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.893809 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.894020 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.894107 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.894326 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.894422 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.894632 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.894735 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.894936 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.895025 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.895270 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.895359 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.895584 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.895680 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.895890 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.895977 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.896197 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.896286 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.896561 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.896661 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.896817 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.896913 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.897134 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.897222 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.897453 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.897542 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.897760 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.897847 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.898087 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.898184 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.898397 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.898483 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.898722 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.898810 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.899034 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.899188 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.899397 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.899486 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.899720 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.899814 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.900032 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.900129 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.900343 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.900431 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.900646 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.900743 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.900887 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 13:26:51.900985 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.901276 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:26:51.901519 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 13:26:52.056965 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO dbcounter [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Registered counter for database nova_api Aug 08 13:26:52.057196 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO dbcounter [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Registered counter for database nova_api Aug 08 13:26:52.077501 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG oslo_db.sqlalchemy.engines [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:26:52.079040 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:26:52.085825 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writer thread running {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:26:52.086699 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writer thread running {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:26:52.142401 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.context [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1(cell1) {{(pid=103426) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 13:26:52.142817 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.context [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1(cell1) {{(pid=103425) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 13:26:52.146316 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG oslo_concurrency.lockutils [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:26:52.146749 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:26:52.146887 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG oslo_concurrency.lockutils [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:26:52.147241 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:26:52.148434 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG oslo_concurrency.lockutils [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:26:52.148878 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:26:52.149153 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG oslo_concurrency.lockutils [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:26:52.149589 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG oslo_concurrency.lockutils [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:26:52.149723 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:26:52.150032 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:26:52.151625 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG oslo_concurrency.lockutils [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:26:52.152203 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:26:52.153679 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO dbcounter [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Registered counter for database nova_cell0 Aug 08 13:26:52.154268 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO dbcounter [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Registered counter for database nova_cell0 Aug 08 13:26:52.159203 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO dbcounter [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Registered counter for database nova_cell1 Aug 08 13:26:52.159789 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO dbcounter [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Registered counter for database nova_cell1 Aug 08 13:26:52.168062 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG oslo_db.sqlalchemy.engines [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:26:52.171367 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:26:52.171513 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG oslo_db.sqlalchemy.engines [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:26:52.175512 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:26:52.175734 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writer thread running {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:26:52.177123 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writer thread running {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:26:52.311237 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writer thread running {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:26:52.316162 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writer thread running {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:26:52.320037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO dbcounter [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Registered counter for database nova_cell0 Aug 08 13:26:52.325000 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO dbcounter [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Registered counter for database nova_cell0 Aug 08 13:26:52.329632 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG oslo_db.sqlalchemy.engines [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:26:52.334554 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:26:52.335037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writer thread running {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:26:52.339999 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writer thread running {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:26:52.670918 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: WARNING keystonemiddleware.auth_token [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 13:26:52.671749 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: WARNING keystonemiddleware.auth_token [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 13:26:52.678315 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: WARNING keystonemiddleware.auth_token [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 13:26:52.679011 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: WARNING keystonemiddleware.auth_token [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 13:26:53.023227 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: WARNING keystonemiddleware.auth_token [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 13:26:53.023788 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: WARNING keystonemiddleware.auth_token [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 13:26:53.029267 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: WARNING keystonemiddleware.auth_token [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 13:26:53.029816 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: WARNING keystonemiddleware.auth_token [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 13:26:53.034615 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56367d47f9c0 pid: 103426 (default app) Aug 08 13:26:53.035157 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56367d47f9c0 pid: 103425 (default app) Aug 08 13:26:53.036747 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:26:53.037922 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-fdccae0d-b8e0-42f0-a676-f388dd299c6a None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001773 Aug 08 13:26:53.038322 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Mon Aug 8 13:26:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:12.947626 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:12.950759 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002904 Aug 08 13:28:12.951918 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:12.974439 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writing DB stats nova_api:SELECT=3 {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:28:12.976241 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writing DB stats nova_cell0:SELECT=3 {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:28:12.977491 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writing DB stats nova_cell1:SELECT=3 {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:28:12.981063 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:28:14.466248 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-2aa391a4-c17a-46fc-b76f-414c1d5251ce admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:14.510358 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-2aa391a4-c17a-46fc-b76f-414c1d5251ce admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.546930 Aug 08 13:28:14.511651 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Aug 8 13:28:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:28:17.257790 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:17.258849 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-6dd5fe4c-c3a3-4c49-b130-b9b97e53bed6 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Aug 08 13:28:17.259293 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:17.878182 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-b3a7e993-c053-4f1a-8d29-c615a8ffeec2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "disk": 1}} {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:17.898445 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 13:28:17.898445 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: warnings.warn(msg) Aug 08 13:28:17.927243 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-b3a7e993-c053-4f1a-8d29-c615a8ffeec2 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.658969 Aug 08 13:28:17.931128 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 13:28:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:28:18.242737 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-9b01bd36-4b1c-43d3-8940-36415d0002f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:18.250975 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 13:28:18.250975 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: warnings.warn(msg) Aug 08 13:28:18.278358 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writing DB stats nova_api:SELECT=3 {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:28:18.279052 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writing DB stats nova_cell0:SELECT=3 {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:28:18.280161 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writing DB stats nova_cell1:SELECT=3 {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:28:18.281337 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:28:18.365705 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-9b01bd36-4b1c-43d3-8940-36415d0002f9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.428422 Aug 08 13:28:18.366682 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Aug 8 13:28:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:28:20.653986 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-b3a7e993-c053-4f1a-8d29-c615a8ffeec2 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:20.655041 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-b3a7e993-c053-4f1a-8d29-c615a8ffeec2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Aug 08 13:28:20.655733 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:21.573419 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-f2b122bb-266b-4fd8-8a4a-da863623bc08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M"}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:21.609458 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 13:28:21.609458 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: warnings.warn(msg) Aug 08 13:28:21.641366 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-f2b122bb-266b-4fd8-8a4a-da863623bc08 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.978028 Aug 08 13:28:21.642494 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 13:28:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:28:21.662459 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-5ef6f437-6557-4d74-b81d-63edc15d9ad3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:21.668241 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 13:28:21.668241 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: warnings.warn(msg) Aug 08 13:28:21.730130 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-5ef6f437-6557-4d74-b81d-63edc15d9ad3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074304 Aug 08 13:28:21.731581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Aug 8 13:28:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:28:24.555302 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-f2b122bb-266b-4fd8-8a4a-da863623bc08 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:24.556373 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-f2b122bb-266b-4fd8-8a4a-da863623bc08 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001670 Aug 08 13:28:24.557337 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:24.998443 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-73778ace-76be-4c9a-a0d9-9b019c3edb84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:25.019498 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-73778ace-76be-4c9a-a0d9-9b019c3edb84 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454494 Aug 08 13:28:25.020297 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 13:28:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:28:25.033155 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-19d4edef-cab3-4a25-b1af-2a7eaf2d23d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:25.062031 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-19d4edef-cab3-4a25-b1af-2a7eaf2d23d6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032858 Aug 08 13:28:25.062537 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Aug 8 13:28:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:28:27.394373 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-73778ace-76be-4c9a-a0d9-9b019c3edb84 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:27.395418 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-73778ace-76be-4c9a-a0d9-9b019c3edb84 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 08 13:28:27.395810 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:27.982963 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-db31dc4d-f22d-4d6f-baa0-30fdf3cfc6ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:28.011478 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-db31dc4d-f22d-4d6f-baa0-30fdf3cfc6ae admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.605894 Aug 08 13:28:28.012263 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 13:28:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:28:28.025007 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-796506af-3535-470b-8409-5b3353a5cf9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:28.051627 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-796506af-3535-470b-8409-5b3353a5cf9d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030423 Aug 08 13:28:28.052491 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Aug 8 13:28:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:28:30.359043 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-db31dc4d-f22d-4d6f-baa0-30fdf3cfc6ae admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:30.360165 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-db31dc4d-f22d-4d6f-baa0-30fdf3cfc6ae admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Aug 08 13:28:30.361141 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:30.849741 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-9dc6ddaa-7703-430f-9795-69374c51e1d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:30.873115 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-9dc6ddaa-7703-430f-9795-69374c51e1d8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505557 Aug 08 13:28:30.874041 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 13:28:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 13:28:30.886589 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-866b24e6-ea1a-4665-814d-15ad361928d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:30.916230 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-866b24e6-ea1a-4665-814d-15ad361928d1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033274 Aug 08 13:28:30.916751 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Aug 8 13:28:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:28:33.619289 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-9dc6ddaa-7703-430f-9795-69374c51e1d8 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:33.620747 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-9dc6ddaa-7703-430f-9795-69374c51e1d8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001952 Aug 08 13:28:33.621134 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:34.206244 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-0df702f3-d56b-44f7-83ec-1c7bc9cc99e2 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:34.245569 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-0df702f3-d56b-44f7-83ec-1c7bc9cc99e2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.615627 Aug 08 13:28:34.246507 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Aug 8 13:28:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:28:36.815179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-9dc6ddaa-7703-430f-9795-69374c51e1d8 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:36.816546 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-9dc6ddaa-7703-430f-9795-69374c51e1d8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002072 Aug 08 13:28:36.817226 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:37.404841 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-a75032bb-6a81-482a-b65e-b8ec31de0c64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:37.428719 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-a75032bb-6a81-482a-b65e-b8ec31de0c64 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.604422 Aug 08 13:28:37.429412 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 13:28:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:28:37.442870 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-02ab011e-f66d-477b-8c9e-20e8a1c33fab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:37.474735 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-02ab011e-f66d-477b-8c9e-20e8a1c33fab admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035038 Aug 08 13:28:37.475994 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Aug 8 13:28:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:28:40.210866 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-a75032bb-6a81-482a-b65e-b8ec31de0c64 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:40.212127 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-a75032bb-6a81-482a-b65e-b8ec31de0c64 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Aug 08 13:28:40.212654 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:40.729487 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-f1a30e1e-cda2-4935-9f09-6d6aad3537bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:40.759377 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-f1a30e1e-cda2-4935-9f09-6d6aad3537bf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.538566 Aug 08 13:28:40.760302 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 13:28:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 13:28:40.774760 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-1a636e89-4a46-4a65-9d62-ec256cdf7c09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:40.802314 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-1a636e89-4a46-4a65-9d62-ec256cdf7c09 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031513 Aug 08 13:28:40.802831 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Aug 8 13:28:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:28:43.279663 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-f1a30e1e-cda2-4935-9f09-6d6aad3537bf admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:43.280800 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-f1a30e1e-cda2-4935-9f09-6d6aad3537bf admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001901 Aug 08 13:28:43.281765 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:43.830927 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-d9c40cbf-96bf-44a4-81e7-f18aec8a7592 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:43.854968 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-d9c40cbf-96bf-44a4-81e7-f18aec8a7592 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.565125 Aug 08 13:28:43.855560 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 13:28:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:28:43.870321 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-f6be2dbf-d379-40ea-8916-c6eb8850c6a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:43.875579 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:28:43.902141 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-f6be2dbf-d379-40ea-8916-c6eb8850c6a3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035705 Aug 08 13:28:43.903418 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Aug 8 13:28:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:28:46.325121 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-d9c40cbf-96bf-44a4-81e7-f18aec8a7592 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:46.326248 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-d9c40cbf-96bf-44a4-81e7-f18aec8a7592 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001759 Aug 08 13:28:46.326744 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:46.809685 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-4235ed75-230b-4738-b35a-554e51fa6613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:46.832945 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-4235ed75-230b-4738-b35a-554e51fa6613 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.499181 Aug 08 13:28:46.835128 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 13:28:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:28:46.845947 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-07665e56-dab1-46f8-a6e4-0b7e2c6393c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:46.876358 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-07665e56-dab1-46f8-a6e4-0b7e2c6393c3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034057 Aug 08 13:28:46.877066 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Aug 8 13:28:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:28:49.151346 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-4235ed75-230b-4738-b35a-554e51fa6613 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:28:49.152384 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-4235ed75-230b-4738-b35a-554e51fa6613 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 08 13:28:49.152819 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:28:49.690521 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-781fa4b9-b5bb-424a-9734-c22fc6db7d7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:49.720540 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-781fa4b9-b5bb-424a-9734-c22fc6db7d7f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.560369 Aug 08 13:28:49.721581 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 13:28:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:28:49.735049 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-f10be4de-c3c3-4ddc-a296-994f608e634c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:28:49.768905 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-f10be4de-c3c3-4ddc-a296-994f608e634c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037946 Aug 08 13:28:49.770075 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Aug 8 13:28:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:29:08.727496 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-781fa4b9-b5bb-424a-9734-c22fc6db7d7f admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:08.728661 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-781fa4b9-b5bb-424a-9734-c22fc6db7d7f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Aug 08 13:29:08.729064 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:29:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:29:08.736885 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:29:09.191979 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-6db6a84e-e727-48ed-bfa1-c4b959f07803 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:09.211299 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-6db6a84e-e727-48ed-bfa1-c4b959f07803 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.475283 Aug 08 13:29:09.211868 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Aug 8 13:29:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:29:10.315382 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-781fa4b9-b5bb-424a-9734-c22fc6db7d7f admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:10.316390 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-781fa4b9-b5bb-424a-9734-c22fc6db7d7f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 08 13:29:10.316791 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:29:10.853335 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-d2ba9803-2347-4340-b053-4fe21ac640ae admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:10.859290 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.wsgi [None req-d2ba9803-2347-4340-b053-4fe21ac640ae admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-d2ba9803-2347-4340-b053-4fe21ac640ae admin admin] Request method failure captured: Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Accept: application/json Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Accept-Encoding: gzip, deflate Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Connection: keep-alive Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Content-Length: 0 Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Host: 10.222.0.33 Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Openstack-Api-Version: compute 2.90 Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Openstack-System-Scope: None Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: User-Agent: python-novaclient Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Auth-Token: gAAAAABi8Q-mZLtaCKZOo7rTdzq1jRnNH1GVNB7fl9DfqNEZskfkYDGHTm0wtOeh19nlIH6-ZyX4wcjjCkz2wKV1R-Th1FirO7izk9uG4Z3MylIKSlGyxbEfJqpGKNmvbtNaKNgKz9MFKprKk1OaVtxEacleyPZqhnEz4ZkRy8N7hgtXBs8lPCw Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Domain-Id: None Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Domain-Name: None Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Identity-Status: Confirmed Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Is-Admin-Project: True Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Domain-Id: default Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Domain-Name: Default Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Name: admin Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Role: reader,admin,member Aug 08 13:29:10.862581 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Roles: reader,admin,member Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cd8972f6a1684e42be6181a89144c88c"}]}] Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Tenant: admin Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Tenant-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Tenant-Name: admin Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User: admin Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Domain-Id: default Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Domain-Name: Default Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Id: 69e577935e2a4950900c965d118c5e00 Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Name: admin Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: method: > Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: exception: Flavor 42 could not be found. Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: action_args: {'id': '42'} Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:29:10.864179 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:10.865262 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:10.866593 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-d2ba9803-2347-4340-b053-4fe21ac640ae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:29:10.867877 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-d2ba9803-2347-4340-b053-4fe21ac640ae admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.408924 Aug 08 13:29:10.867877 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Aug 8 13:29:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 13:29:10.874610 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-2807f004-1382-42d4-bce6-b241ceabcff1 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:10.879101 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:29:10.899658 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-2807f004-1382-42d4-bce6-b241ceabcff1 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028889 Aug 08 13:29:10.900211 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 13:29:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:29:10.910398 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-0ac6c388-d036-44e4-9be9-d7d47a76a6c4 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:10.934863 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-0ac6c388-d036-44e4-9be9-d7d47a76a6c4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028195 Aug 08 13:29:10.935466 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 13:29:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:29:10.945277 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-af4985dd-66bd-4ba6-b521-fdd84e385544 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:10.951921 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.wsgi [None req-af4985dd-66bd-4ba6-b521-fdd84e385544 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-af4985dd-66bd-4ba6-b521-fdd84e385544 admin admin] Request method failure captured: Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Accept: application/json Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Accept-Encoding: gzip, deflate Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Connection: keep-alive Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Content-Length: 0 Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Host: 10.222.0.33 Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Openstack-Api-Version: compute 2.90 Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Openstack-System-Scope: None Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: User-Agent: python-novaclient Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Auth-Token: gAAAAABi8Q-mZLtaCKZOo7rTdzq1jRnNH1GVNB7fl9DfqNEZskfkYDGHTm0wtOeh19nlIH6-ZyX4wcjjCkz2wKV1R-Th1FirO7izk9uG4Z3MylIKSlGyxbEfJqpGKNmvbtNaKNgKz9MFKprKk1OaVtxEacleyPZqhnEz4ZkRy8N7hgtXBs8lPCw Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Domain-Id: None Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Domain-Name: None Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Identity-Status: Confirmed Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Is-Admin-Project: True Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Domain-Id: default Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Domain-Name: Default Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Name: admin Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Role: reader,admin,member Aug 08 13:29:10.955257 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Roles: reader,admin,member Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cd8972f6a1684e42be6181a89144c88c"}]}] Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Tenant: admin Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Tenant-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Tenant-Name: admin Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User: admin Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Domain-Id: default Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Domain-Name: Default Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Id: 69e577935e2a4950900c965d118c5e00 Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Name: admin Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: method: > Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: exception: Flavor 42 could not be found. Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: action_args: {'id': '42'} Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:29:10.956880 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:10.957876 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:10.959523 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-af4985dd-66bd-4ba6-b521-fdd84e385544 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:29:10.960790 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-af4985dd-66bd-4ba6-b521-fdd84e385544 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015036 Aug 08 13:29:10.960790 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Aug 8 13:29:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 13:29:11.944108 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-0ac6c388-d036-44e4-9be9-d7d47a76a6c4 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:11.945166 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-0ac6c388-d036-44e4-9be9-d7d47a76a6c4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 08 13:29:11.945566 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:29:12.514414 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-69e12cce-fed8-4ce3-ab0c-cb9ba32b3e56 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:12.519839 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.wsgi [None req-69e12cce-fed8-4ce3-ab0c-cb9ba32b3e56 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-69e12cce-fed8-4ce3-ab0c-cb9ba32b3e56 admin admin] Request method failure captured: Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Accept: application/json Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Accept-Encoding: gzip, deflate Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Connection: keep-alive Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Content-Length: 0 Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Host: 10.222.0.33 Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Openstack-Api-Version: compute 2.90 Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Openstack-System-Scope: None Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: User-Agent: python-novaclient Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Auth-Token: gAAAAABi8Q-nm9uh-KpAZ-qSqb4v5uD2rh-nSvA6O9dKfiqrWJPO5hqdoN25cck0_KV_yXXAxmTKnZn-GZWp9AcqmhPUWT9zeiqzfYjwxlN2_e2axPwFK_Z4JznYr0Ely6a7QdK5GJBIdyf_FZI_b-vZpcK6sv31TmgTc9vcFts-ERvL0AajMR4 Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Domain-Id: None Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Domain-Name: None Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Identity-Status: Confirmed Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Is-Admin-Project: True Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Domain-Id: default Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Domain-Name: Default Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Name: admin Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Role: reader,admin,member Aug 08 13:29:12.521427 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Roles: reader,admin,member Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cd8972f6a1684e42be6181a89144c88c"}]}] Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Tenant: admin Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Tenant-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Tenant-Name: admin Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User: admin Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Domain-Id: default Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Domain-Name: Default Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Id: 69e577935e2a4950900c965d118c5e00 Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Name: admin Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: method: > Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: exception: Flavor 84 could not be found. Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: action_args: {'id': '84'} Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:29:12.522786 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:12.523721 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:12.525081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-69e12cce-fed8-4ce3-ab0c-cb9ba32b3e56 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:29:12.526429 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-69e12cce-fed8-4ce3-ab0c-cb9ba32b3e56 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.430588 Aug 08 13:29:12.526429 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Aug 8 13:29:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 13:29:12.532929 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-64d20fe8-461c-4387-ab69-7fcec4dbee60 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:12.548195 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-64d20fe8-461c-4387-ab69-7fcec4dbee60 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018822 Aug 08 13:29:12.548754 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 13:29:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:29:12.558981 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-8fb90aa6-95d4-42fb-99e4-7777041e98c3 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:12.576468 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-8fb90aa6-95d4-42fb-99e4-7777041e98c3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021056 Aug 08 13:29:12.577036 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 13:29:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:29:12.586850 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-bd2c2601-20a8-40c5-8774-3eb709f5536d admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:12.593243 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.wsgi [None req-bd2c2601-20a8-40c5-8774-3eb709f5536d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-bd2c2601-20a8-40c5-8774-3eb709f5536d admin admin] Request method failure captured: Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Accept: application/json Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Accept-Encoding: gzip, deflate Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Connection: keep-alive Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Content-Length: 0 Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Host: 10.222.0.33 Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Openstack-Api-Version: compute 2.90 Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Openstack-System-Scope: None Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: User-Agent: python-novaclient Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Auth-Token: gAAAAABi8Q-nm9uh-KpAZ-qSqb4v5uD2rh-nSvA6O9dKfiqrWJPO5hqdoN25cck0_KV_yXXAxmTKnZn-GZWp9AcqmhPUWT9zeiqzfYjwxlN2_e2axPwFK_Z4JznYr0Ely6a7QdK5GJBIdyf_FZI_b-vZpcK6sv31TmgTc9vcFts-ERvL0AajMR4 Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Domain-Id: None Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Domain-Name: None Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Identity-Status: Confirmed Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Is-Admin-Project: True Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Domain-Id: default Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Domain-Name: Default Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Name: admin Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Role: reader,admin,member Aug 08 13:29:12.594781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Roles: reader,admin,member Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cd8972f6a1684e42be6181a89144c88c"}]}] Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Tenant: admin Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Tenant-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Tenant-Name: admin Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User: admin Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Domain-Id: default Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Domain-Name: Default Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Id: 69e577935e2a4950900c965d118c5e00 Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Name: admin Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: method: > Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: exception: Flavor 84 could not be found. Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: action_args: {'id': '84'} Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:29:12.596283 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:12.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:12.598424 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-bd2c2601-20a8-40c5-8774-3eb709f5536d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:29:12.599479 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-bd2c2601-20a8-40c5-8774-3eb709f5536d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013018 Aug 08 13:29:12.599479 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Aug 8 13:29:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 13:29:13.576672 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-8fb90aa6-95d4-42fb-99e4-7777041e98c3 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:13.577856 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-8fb90aa6-95d4-42fb-99e4-7777041e98c3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Aug 08 13:29:13.578336 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:29:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:29:14.177734 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-baf6f97c-3aaf-4cc5-a59b-5dbdf5aff747 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:14.184407 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.wsgi [None req-baf6f97c-3aaf-4cc5-a59b-5dbdf5aff747 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-baf6f97c-3aaf-4cc5-a59b-5dbdf5aff747 admin admin] Request method failure captured: Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Accept: application/json Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Accept-Encoding: gzip, deflate Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Connection: keep-alive Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Content-Length: 0 Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Host: 10.222.0.33 Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Openstack-Api-Version: compute 2.90 Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Openstack-System-Scope: None Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: User-Agent: python-novaclient Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Auth-Token: gAAAAABi8Q-pDSbzQ7E54nb-DE3vXk-GUyBjZhyyUyUGpI6QoCc-NL6wUoFOR-TT9xJHC-uyzA8795-O6h5x-ZZ40Ysm3h7uLqQ4ZMbgPtOnX1TnZ61MIKzRg1QrLvOdqMMMB5k1vDePizQtDyGPp0SnREO7hSa4m4W6SiUGxR8tiQSCQe-8U4c Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Domain-Id: None Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Domain-Name: None Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Identity-Status: Confirmed Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Is-Admin-Project: True Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Domain-Id: default Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Domain-Name: Default Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Project-Name: admin Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Role: reader,admin,member Aug 08 13:29:14.186037 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Roles: reader,admin,member Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cd8972f6a1684e42be6181a89144c88c"}]}] Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Tenant: admin Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Tenant-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-Tenant-Name: admin Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User: admin Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Domain-Id: default Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Domain-Name: Default Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Id: 69e577935e2a4950900c965d118c5e00 Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: X-User-Name: admin Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: method: > Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: exception: Flavor 451 could not be found. Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: action_args: {'id': '451'} Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:29:14.187888 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:14.192113 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: ERROR nova.api.openstack.wsgi Aug 08 13:29:14.193514 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-baf6f97c-3aaf-4cc5-a59b-5dbdf5aff747 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:29:14.194751 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-baf6f97c-3aaf-4cc5-a59b-5dbdf5aff747 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.472856 Aug 08 13:29:14.194751 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 13:29:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 474 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 13:29:14.197471 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-51995403-ef8e-4794-8b37-785c68d0d009 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:14.220761 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-51995403-ef8e-4794-8b37-785c68d0d009 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026914 Aug 08 13:29:14.226286 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 13:29:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:29:14.231726 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:14.247516 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019588 Aug 08 13:29:14.248087 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 13:29:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:29:14.257773 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-a05651c3-e706-4459-8fbc-2cb0af070625 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:14.263713 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.wsgi [None req-a05651c3-e706-4459-8fbc-2cb0af070625 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-a05651c3-e706-4459-8fbc-2cb0af070625 admin admin] Request method failure captured: Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Accept: application/json Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Accept-Encoding: gzip, deflate Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Connection: keep-alive Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Content-Length: 0 Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Host: 10.222.0.33 Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Openstack-Api-Version: compute 2.90 Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Openstack-System-Scope: None Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: User-Agent: python-novaclient Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Auth-Token: gAAAAABi8Q-pDSbzQ7E54nb-DE3vXk-GUyBjZhyyUyUGpI6QoCc-NL6wUoFOR-TT9xJHC-uyzA8795-O6h5x-ZZ40Ysm3h7uLqQ4ZMbgPtOnX1TnZ61MIKzRg1QrLvOdqMMMB5k1vDePizQtDyGPp0SnREO7hSa4m4W6SiUGxR8tiQSCQe-8U4c Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Domain-Id: None Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Domain-Name: None Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Identity-Status: Confirmed Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Is-Admin-Project: True Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Domain-Id: default Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Domain-Name: Default Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Project-Name: admin Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Role: reader,admin,member Aug 08 13:29:14.265159 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Roles: reader,admin,member Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cd8972f6a1684e42be6181a89144c88c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cd8972f6a1684e42be6181a89144c88c"}]}] Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Tenant: admin Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Tenant-Id: cd8972f6a1684e42be6181a89144c88c Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-Tenant-Name: admin Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User: admin Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Domain-Id: default Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Domain-Name: Default Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Id: 69e577935e2a4950900c965d118c5e00 Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: X-User-Name: admin Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: method: > Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: exception: Flavor 451 could not be found. Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: action_args: {'id': '451'} Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:29:14.266804 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:14.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: ERROR nova.api.openstack.wsgi Aug 08 13:29:14.269353 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-a05651c3-e706-4459-8fbc-2cb0af070625 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:29:14.270809 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-a05651c3-e706-4459-8fbc-2cb0af070625 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012412 Aug 08 13:29:14.270809 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 13:29:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 13:29:15.236419 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:15.237407 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 08 13:29:15.237808 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:29:15.782857 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-8a498c10-825a-4a79-9d8e-746ce65d1f8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:29:15.803870 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-8a498c10-825a-4a79-9d8e-746ce65d1f8b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.429612 Aug 08 13:29:15.804430 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Aug 8 13:29:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:29:16.792295 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:16.793314 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 08 13:29:16.793723 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:29:17.342140 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-4ea0cac2-2785-41f1-9e12-5c1de1f38b84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:29:17.362525 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-4ea0cac2-2785-41f1-9e12-5c1de1f38b84 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.431303 Aug 08 13:29:17.363071 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Aug 8 13:29:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:29:18.348555 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:18.349550 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 08 13:29:18.349948 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:29:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:29:18.919100 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-8b41541d-008e-429a-a855-bf5fdab334f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:29:18.943883 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-8b41541d-008e-429a-a855-bf5fdab334f1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.440154 Aug 08 13:29:18.944438 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Aug 8 13:29:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:29:19.926685 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:19.928373 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002321 Aug 08 13:29:19.928968 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:29:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:29:20.476686 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-55d6d572-7972-4cbc-84f7-b69d247bdec3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:29:20.497845 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-55d6d572-7972-4cbc-84f7-b69d247bdec3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.427450 Aug 08 13:29:20.498388 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Aug 8 13:29:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 13:29:21.526188 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:21.527229 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 08 13:29:21.527630 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:29:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:29:22.076510 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-eed0080c-fa28-49bc-bb17-82485f3c936d admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:29:22.097502 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-eed0080c-fa28-49bc-bb17-82485f3c936d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.433183 Aug 08 13:29:22.097956 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Mon Aug 8 13:29:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:30:14.216141 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:30:14.217161 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-84343022-5c40-49e0-8606-d0f71c507020 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 08 13:30:14.217562 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 13:30:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:30:14.228755 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:30:14.650933 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-f199ed23-851d-4d4c-8f64-211c009fb8c2 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:30:14.671428 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-f199ed23-851d-4d4c-8f64-211c009fb8c2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.447420 Aug 08 13:30:14.671986 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Aug 8 13:30:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:30:14.693151 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG dbcounter [-] [103426] Writing DB stats nova_api:SELECT=14 {{(pid=103426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:30:14.697321 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-1e9e2ea1-ed39-4561-9894-a698c46454b6 admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:30:14.705358 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-1e9e2ea1-ed39-4561-9894-a698c46454b6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013652 Aug 08 13:30:14.706156 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1283 bytes} [Mon Aug 8 13:30:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:30:14.718493 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-284a0536-d2f1-4ca9-bed6-2783f33567cf admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:30:14.727162 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-284a0536-d2f1-4ca9-bed6-2783f33567cf admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012306 Aug 08 13:30:14.727807 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1286 bytes} [Mon Aug 8 13:30:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:30:14.740221 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-eb7a69f2-71f3-4dc4-8357-e98273f3a67c admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:30:14.748781 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-eb7a69f2-71f3-4dc4-8357-e98273f3a67c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012256 Aug 08 13:30:14.749340 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1286 bytes} [Mon Aug 8 13:30:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:30:14.762220 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-827ac49b-9e2b-4ba4-961b-505063f659f5 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:30:14.770237 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-827ac49b-9e2b-4ba4-961b-505063f659f5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011982 Aug 08 13:30:14.770813 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1283 bytes} [Mon Aug 8 13:30:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:33:15.008097 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-eb7a69f2-71f3-4dc4-8357-e98273f3a67c admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:33:15.009108 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-eb7a69f2-71f3-4dc4-8357-e98273f3a67c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 08 13:33:15.009496 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:33:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:33:15.153580 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writing DB stats nova_api:SELECT=6 {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:33:15.320842 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-dfd667bc-79cb-4bcc-8e06-0725db7e5ae9 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:33:15.323414 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 13:33:15.323414 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: warnings.warn(msg) Aug 08 13:33:15.324514 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-dfd667bc-79cb-4bcc-8e06-0725db7e5ae9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:33:15.324976 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-dfd667bc-79cb-4bcc-8e06-0725db7e5ae9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:33:15.325372 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-dfd667bc-79cb-4bcc-8e06-0725db7e5ae9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:33:15.326081 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-dfd667bc-79cb-4bcc-8e06-0725db7e5ae9 admin admin] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:33:15.326513 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-dfd667bc-79cb-4bcc-8e06-0725db7e5ae9 admin admin] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:33:15.326919 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-dfd667bc-79cb-4bcc-8e06-0725db7e5ae9 admin admin] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:33:15.359780 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-dfd667bc-79cb-4bcc-8e06-0725db7e5ae9 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.207613 Aug 08 13:33:15.360338 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 13:33:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:33:16.238516 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-eb7a69f2-71f3-4dc4-8357-e98273f3a67c admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:33:16.239557 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-eb7a69f2-71f3-4dc4-8357-e98273f3a67c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 08 13:33:16.239953 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:33:16.441441 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-a52efa7d-b687-4ac8-8c40-df95acf0ec76 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:33:16.445049 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 13:33:16.445049 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: warnings.warn(msg) Aug 08 13:33:16.446689 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-a52efa7d-b687-4ac8-8c40-df95acf0ec76 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:33:16.447404 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-a52efa7d-b687-4ac8-8c40-df95acf0ec76 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:33:16.447940 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-a52efa7d-b687-4ac8-8c40-df95acf0ec76 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:33:16.448923 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-a52efa7d-b687-4ac8-8c40-df95acf0ec76 admin admin] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:33:16.449512 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-a52efa7d-b687-4ac8-8c40-df95acf0ec76 admin admin] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:33:16.450005 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-a52efa7d-b687-4ac8-8c40-df95acf0ec76 admin admin] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:33:16.473501 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-a52efa7d-b687-4ac8-8c40-df95acf0ec76 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.094464 Aug 08 13:33:16.474084 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 13:33:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:33:27.711632 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-eb7a69f2-71f3-4dc4-8357-e98273f3a67c admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:33:27.712678 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-eb7a69f2-71f3-4dc4-8357-e98273f3a67c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 08 13:33:27.713076 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:33:27.855485 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writing DB stats nova_cell0:SELECT=4 {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:33:27.856207 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writing DB stats nova_cell1:SELECT=4 {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:33:27.856802 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG dbcounter [-] [103425] Writing DB stats nova_api:SELECT=8 {{(pid=103425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:33:27.916995 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-61a5ceff-d490-4862-b90d-771eea715808 admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:33:27.919490 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 13:33:27.919490 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: warnings.warn(msg) Aug 08 13:33:27.920616 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-61a5ceff-d490-4862-b90d-771eea715808 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:33:27.921083 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-61a5ceff-d490-4862-b90d-771eea715808 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:33:27.921502 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-61a5ceff-d490-4862-b90d-771eea715808 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:33:27.922200 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-61a5ceff-d490-4862-b90d-771eea715808 admin admin] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:33:27.922636 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-61a5ceff-d490-4862-b90d-771eea715808 admin admin] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:33:27.923049 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-61a5ceff-d490-4862-b90d-771eea715808 admin admin] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:33:27.949414 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-61a5ceff-d490-4862-b90d-771eea715808 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.099459 Aug 08 13:33:27.950165 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 37/74] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 13:33:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:33:28.797447 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: DEBUG nova.api.openstack.wsgi [None req-eb7a69f2-71f3-4dc4-8357-e98273f3a67c admin admin] Calling method '>' {{(pid=103426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:33:28.798460 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: INFO nova.api.openstack.requestlog [None req-eb7a69f2-71f3-4dc4-8357-e98273f3a67c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 08 13:33:28.798858 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: [pid: 103426|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 13:33:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:33:28.999017 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG nova.api.openstack.wsgi [None req-92911237-933c-48d6-8912-0ca935aec49f admin admin] Calling method '>' {{(pid=103425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:33:29.001408 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 13:33:29.001408 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: warnings.warn(msg) Aug 08 13:33:29.002505 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-92911237-933c-48d6-8912-0ca935aec49f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:33:29.002972 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-92911237-933c-48d6-8912-0ca935aec49f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:33:29.003426 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-92911237-933c-48d6-8912-0ca935aec49f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:33:29.004125 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-92911237-933c-48d6-8912-0ca935aec49f admin admin] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:33:29.004571 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-92911237-933c-48d6-8912-0ca935aec49f admin admin] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:33:29.004969 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: DEBUG oslo_concurrency.lockutils [None req-92911237-933c-48d6-8912-0ca935aec49f admin admin] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:33:29.026622 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: INFO nova.api.openstack.requestlog [None req-92911237-933c-48d6-8912-0ca935aec49f admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087923 Aug 08 13:33:29.027195 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: [pid: 103425|app: 0|req: 38/76] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 13:33:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:34:26.006738 dv-cinder-851996-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 08 13:34:26.007499 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: Mon Aug 8 13:34:26 2022 - graceful shutdown triggered... Aug 08 13:34:26.007997 dv-cinder-851996-6-iscsi devstack@n-api.service[103425]: Gracefully killing worker 1 (pid: 103425)... Aug 08 13:34:26.008360 dv-cinder-851996-6-iscsi devstack@n-api.service[103426]: Gracefully killing worker 2 (pid: 103426)... Aug 08 13:34:27.008703 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: worker 1 buried after 1 seconds Aug 08 13:34:27.008703 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: worker 2 buried after 1 seconds Aug 08 13:34:27.008703 dv-cinder-851996-6-iscsi devstack@n-api.service[103424]: goodbye to uWSGI. Aug 08 13:34:27.010520 dv-cinder-851996-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 08 13:34:27.011135 dv-cinder-851996-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 08 13:34:27.014301 dv-cinder-851996-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 13:34:27.025783 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 13:34:27 2022] *** Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: nodename: dv-cinder-851996-6-iscsi Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: machine: x86_64 Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: clock source: unix Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: pcre jit disabled Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: detected number of CPU cores: 4 Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: current working directory: / Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: detected binary path: /usr/bin/uwsgi-core Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: your processes number limit is 47680 Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: your memory page size is 4096 bytes Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: detected max file descriptor number: 2048 Aug 08 13:34:27.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: lock engine: pthread robust mutexes Aug 08 13:34:27.028739 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: thunder lock: enabled Aug 08 13:34:27.028739 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 13:34:27.028739 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 13:34:27.069272 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: Python main interpreter initialized at 0x55dc2af319c0 Aug 08 13:34:27.069272 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: python threads support enabled Aug 08 13:34:27.069272 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: your server socket listen backlog is limited to 100 connections Aug 08 13:34:27.069272 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: your mercy for graceful operations on workers is 90 seconds Aug 08 13:34:27.069741 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 13:34:27.069741 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: *** Operational MODE: preforking *** Aug 08 13:34:27.069987 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: *** uWSGI is running in multiple interpreter mode *** Aug 08 13:34:27.069987 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: spawned uWSGI master process (pid: 124385) Aug 08 13:34:27.070205 dv-cinder-851996-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 13:34:27.070745 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: spawned uWSGI worker 1 (pid: 124407, cores: 1) Aug 08 13:34:27.072106 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: spawned uWSGI worker 2 (pid: 124408, cores: 1) Aug 08 13:34:27.072106 dv-cinder-851996-6-iscsi devstack@n-api.service[124385]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 13:34:27.725319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 13:34:27.744898 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 13:34:28.854093 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 13:34:28.854093 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: from cryptography.utils import int_from_bytes Aug 08 13:34:28.854790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 13:34:28.854790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: from cryptography.utils import int_from_bytes Aug 08 13:34:28.885139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 13:34:28.885139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: from cryptography.utils import int_from_bytes Aug 08 13:34:28.885721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 13:34:28.885721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: from cryptography.utils import int_from_bytes Aug 08 13:34:31.129406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 13:34:31.129985 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 13:34:31.130188 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 13:34:31.130546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 13:34:31.130881 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 13:34:31.131209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.131534 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.131849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.132171 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.132556 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.132851 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.133113 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.133429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.133751 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.134005 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.134320 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.134636 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-6-iscsi {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.134960 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.135288 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.135595 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.135907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.136209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.136527 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.136828 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.137319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.138569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.138569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.138569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.138816 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.138955 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.139284 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.139598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.139901 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.140218 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.140521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.140917 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-6-iscsi {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.141233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.141574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.141854 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.142288 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.142652 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.142882 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.143227 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.143558 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.143862 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.144183 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.144561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.144878 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.145191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.145493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.145794 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.146097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.146408 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.147876 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.147876 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.147876 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.147876 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.147876 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.148271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.148482 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.148697 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.148941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.149256 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.149575 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.149876 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.150178 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.150477 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.150776 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.151127 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.151393 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.151694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.151993 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.152304 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.152613 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.152928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.153228 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.153538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.153945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.154192 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.154493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.154830 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.155165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.155474 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.155787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.156102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.156403 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.156705 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.157006 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.157323 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.157638 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.157935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.158183 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.158480 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.158778 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.159098 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.159408 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.159708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.160031 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.160326 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.160626 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.160925 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.161225 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.161527 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.161826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.162122 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.162419 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.162719 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.163015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.163351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.163664 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.163964 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.164260 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.164557 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.164856 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.165169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.165469 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.165767 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.166078 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.166376 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.166672 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.166986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.167382 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.167609 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.167920 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.168214 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.168515 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.168823 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.169123 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.169423 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.169719 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.170030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.170327 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.170623 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.170917 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.171264 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.171539 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.171851 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.172165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.172468 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.172768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.173061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.173374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.173783 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.174029 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.174367 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.174678 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.175005 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.175360 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.175729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.176039 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.176346 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.176665 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.176971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.177276 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.177629 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.177902 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.178215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.178553 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.178865 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.179202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.179530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.179835 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.180368 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.180703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.181025 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.181333 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.181673 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.181998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.182308 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.182618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.182937 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.183282 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.183592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.183898 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.184217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.184566 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.184886 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.185201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.185515 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.185822 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.186127 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.186434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.186742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.187373 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.187620 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.187737 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.188015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.188343 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.188665 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.188972 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.189314 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.189627 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.189929 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.190228 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.190535 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.190845 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.191187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.191538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.191842 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.192175 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.192475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.192781 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.193109 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.193391 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.193693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.193997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.194301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.194598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.194746 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 13:34:31.195246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.195402 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 13:34:31.195578 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.195800 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 13:34:31.195940 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.195940 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.196171 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 13:34:31.196171 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 13:34:31.196313 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.196392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.196463 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.196698 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.196881 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.197062 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.197205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.197379 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.197555 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.197800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.197943 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.198189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.198343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.198484 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.198633 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.198781 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.198940 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.199135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.199298 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.199298 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.199578 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.199715 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.199865 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.200005 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-6-iscsi {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.200144 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.200282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.200426 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.200750 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.200900 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.200992 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.201084 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.201170 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.201254 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.201345 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.201462 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.201577 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.201723 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.201882 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.201974 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.202184 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.202375 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.202492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.202683 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.202777 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.202985 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.203122 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.203328 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.203481 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.203659 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.203769 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.203962 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.204108 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.204254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.204348 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.204569 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.204707 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.204870 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.205023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.205174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.205295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.205482 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.205629 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.205864 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.206010 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-6-iscsi {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.206167 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.206308 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.206465 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.206616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.206754 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.206945 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.207042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.207293 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.207388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.207602 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.207712 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.207940 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.208040 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.208282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.208397 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.208529 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.208644 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.208828 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.208929 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.209147 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.209268 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.209461 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.209565 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.209766 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.209864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.210080 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.210191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.210384 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.210479 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.210717 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.210816 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.211022 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.211204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.211362 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.211482 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.211661 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.211781 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.211970 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.212098 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.212225 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.212342 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.212504 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.212623 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.212821 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.212947 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.213136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.213255 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.213456 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.213586 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.213705 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.213833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.213952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.214116 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.214235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.214422 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.214540 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.214728 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.214867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.215054 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.215326 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.216495 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.216627 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.216732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.216875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.216966 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.217082 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.217182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.217325 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.217414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.217529 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.217620 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.217759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.217849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.218083 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.218194 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.218354 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.218446 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.218653 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.218744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.218827 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.218921 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.219063 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.219182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.219278 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.219379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.219473 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.219560 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.219644 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.219737 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.219822 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.219970 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.220110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.220205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.220409 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.220510 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.220711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.220814 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.221014 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.221114 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.221324 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.221425 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.221621 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.221725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.221921 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.222021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.222221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.222322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.222558 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.222665 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.222862 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.222956 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.223126 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.223427 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.223726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.224039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.224168 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.224341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.224458 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.224655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.224805 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.224942 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.225059 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.225296 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.225400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.225596 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.225704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.225896 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.225990 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.226200 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.226292 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.226500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.226608 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.226800 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.226902 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.227128 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.227227 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.227418 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.227521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.227729 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.227832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.228017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.228128 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.228332 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.228444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.228645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.228743 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.228942 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.229033 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.229239 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.229342 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.229537 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.229645 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.229838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.229932 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.230150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.230251 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.230446 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.230549 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.230749 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.230843 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.231065 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.231169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.231388 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.231493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.231686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.231780 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.231991 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.232084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.232289 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.232381 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.232588 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.232692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.232891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.232984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.233182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.233284 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.233482 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.233584 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.233790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.233890 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.234087 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.234180 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.234383 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.234483 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.234680 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.234782 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.234979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.235092 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.235312 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.235588 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.235713 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.235893 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.236022 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.236187 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.236291 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.236478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.236574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.236793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.236888 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.237117 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.237228 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.237416 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.237525 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.237717 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.237813 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.238016 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.238145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.238406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 13:34:31.238549 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.238694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.238802 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.239052 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.239239 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.239326 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.239400 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.239614 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.239723 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.239914 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.240019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.240225 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.240324 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.240511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.240622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.240817 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.241062 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.241156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.241379 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.241482 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.241705 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.242006 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.242314 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.242615 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.243302 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.243472 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.243630 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.243790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.243943 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.244088 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.244238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.244384 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.244537 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.244690 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.244835 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.244989 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.245143 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.245308 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.246057 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.246222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.246369 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.246514 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.246666 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.246815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.246974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.247277 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.247441 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.247441 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.247737 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.247892 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.248070 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.248304 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.248471 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.249644 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.249817 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.249974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.250136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.250711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.250877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.251032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.251226 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.251385 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.251530 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.251701 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.251965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.252128 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.252273 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.252431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.252584 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.252735 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.252880 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.253023 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.253166 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.253339 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.253485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.253648 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.254211 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.254374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.254527 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.254687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.254839 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.254984 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.255191 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.255537 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.255537 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.255836 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.255994 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.256146 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.256296 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.256440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.256598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.256754 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.256906 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.257051 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.257194 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.257410 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.257577 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.257731 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.257883 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.258044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.258197 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.258438 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.258599 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.258743 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.258893 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.259044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.259218 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.259466 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.259622 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.259766 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.259956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.260113 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.260257 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.260498 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.260657 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.260907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.261058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.261221 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.261374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.261532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.261685 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.261836 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.261987 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.262138 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.262304 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.262457 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.262602 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.262754 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.262897 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.263048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.263377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.263570 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.263727 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.263890 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.264034 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.264177 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.264328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.264492 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.264638 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.264781 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.264923 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.265073 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.265226 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.265377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.265521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.265671 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.265815 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.265959 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.266118 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.266262 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.266424 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.266570 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.266721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.266874 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.267018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.267195 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.267340 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.267547 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.267694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.267857 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.268003 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.268145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.268307 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.268476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.268712 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.268875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.269039 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.269198 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.269351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.269689 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.269850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.269995 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.270146 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.270291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.270434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.270690 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.270858 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.271134 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.271289 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.271433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.271575 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.271720 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.271872 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.272024 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.272169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.272320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.272465 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.272618 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.272785 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.272931 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.273086 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.273243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.273406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.273552 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.273705 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.273858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.274002 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.274159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.274311 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.274470 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.274615 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.274768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.274922 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.275067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.275247 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.275409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.275554 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.275705 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.275849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.275993 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.276137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.276288 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.276440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.276586 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.276789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.276939 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.277083 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.277235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.277388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.277388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.277715 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.277868 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.278028 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.278189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.278334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.278485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.278648 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.278880 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.279039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.279210 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.279355 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.279497 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.279668 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.279894 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.280054 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.280219 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.281346 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.281510 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.281658 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.281823 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.281984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.282137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.282291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.282435 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.282587 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.282745 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.282897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.282897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.283254 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.283417 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.283563 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.283724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.283882 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.284026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.284169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.284169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.284460 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.284613 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.284757 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.284906 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.285127 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.285281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.285426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.285587 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.285732 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.285732 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.286023 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.286167 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.286320 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.286466 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.286617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.286767 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.286912 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.287056 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.287241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.287527 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.287728 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.287893 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.288039 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.288182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.288339 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.288493 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.288646 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.288646 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.289012 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.289163 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.289359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.289566 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.289739 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.289918 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.290162 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.290313 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.290466 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.290466 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.290768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.290991 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.291170 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.291351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.291591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.291742 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.291924 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.292074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.292217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.292386 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.292540 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.292684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.292828 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.292970 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.293121 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.293274 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.293436 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.293582 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.293735 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.293889 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.294042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.294187 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.294341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.294492 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.294644 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.294797 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.294950 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.295158 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.295311 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.295465 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.295660 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.295918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.296095 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.296243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.296405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.296559 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.296704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.296859 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.297134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.297293 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.297445 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.297591 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.297591 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.297927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.298083 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.298227 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.298369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.298524 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.298668 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.298820 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.298983 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.299215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.299377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.299525 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.299676 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.299830 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.299984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.300157 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.300387 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.300538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.300695 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.300849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.301019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.301246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.301396 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.301539 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.301831 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.301987 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.302146 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.302795 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.302952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.303134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.303307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.303475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.303475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.303760 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.303760 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.304049 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.304210 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.304356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.304356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.304629 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.304772 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.304917 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.305152 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.305321 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.305467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.305610 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.305761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.305913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.306067 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.306212 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.306938 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.307124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.307288 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.307446 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.307592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.307737 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.307949 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.308095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.308240 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.308395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.308540 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.308683 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.308834 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.308987 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.309132 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.309132 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.309526 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.309673 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.309826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.309982 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.310141 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.310294 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.310529 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.310680 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.310833 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.310986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.311238 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.311468 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.311619 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.311799 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.312044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.312209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.312367 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.312513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.312673 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.312818 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.312976 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.313130 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.313282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.313429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.313582 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.313738 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.313884 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.314027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.314188 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.314341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.314494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.314653 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.314800 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.314944 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.315106 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.315257 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.315401 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.315557 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.315703 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.315856 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.316001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.316163 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.316405 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.316574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.316721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.316867 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.317011 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.317154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.317314 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.317469 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.317613 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.317766 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.317958 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.318113 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.318290 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.318290 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.318579 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.318730 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.318881 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.319038 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.319272 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.319521 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.319679 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.319837 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.319997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.319997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.320296 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.320467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.320717 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.320875 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.321027 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.321187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.321339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.321611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.321768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.321917 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.322084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.322336 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.322493 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.322493 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.322791 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.322948 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.323120 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.323292 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.323461 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.323614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.323772 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.323933 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.324144 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.324296 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.324446 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.324842 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.325012 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.325165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.325345 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.325581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.325747 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.325908 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.326061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.326268 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.326268 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.326572 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.326723 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.326881 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.327044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.327221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.327391 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.327552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.327739 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.327904 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.328097 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.328269 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.328423 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.328574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.328724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.328873 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.329023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.329192 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.329344 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.329521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.329752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.329907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.330072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.330384 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.330595 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.330863 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.331021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.331278 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.331443 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.331700 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.331894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.332062 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.332222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.332388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.332543 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.332822 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.332980 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.333140 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.333302 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.333463 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.333616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.333616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.333976 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.334128 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.334292 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.334454 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.334617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.334790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.338241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.339671 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.339872 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.340044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.340203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.340380 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.340546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.340709 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.340880 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.341037 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.341196 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.341348 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.341348 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.341691 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.341849 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.342001 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.342160 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.342312 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.342487 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.342639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.342817 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.342974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.344886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.345577 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.345744 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.345913 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.346082 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.346244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.346406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.346406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.346701 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.346854 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.347020 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.347217 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.347372 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.347599 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.347919 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.348092 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.348291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.348446 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.348605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.348758 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.348923 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.349076 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.349235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.349387 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.349537 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.349686 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.349851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.350026 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.350179 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.350179 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.350484 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.350643 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.350808 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.350960 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.351136 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.351294 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.351444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.351604 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.351769 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.351945 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.352120 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.352275 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.352426 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.352592 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.352754 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.352907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.353057 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.353216 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.353388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.353623 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.353789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.353942 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.354510 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.354695 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.354849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.355014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.355194 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.355359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.355511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.355674 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.355834 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.355996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.356194 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.356357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.356509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.356660 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.356836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.357029 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.357200 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.357361 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.357513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.357665 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.357826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.357985 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.358144 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.358352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.358511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.358663 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.358836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.358989 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.359160 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.359327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.359479 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.359638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.359835 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.360001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.360152 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.360302 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.360460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.360621 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.360773 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.360935 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.361096 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.361256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.361407 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.361567 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.361718 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.361868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.362018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.362168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.362327 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.362494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.362647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.362809 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.362973 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.363380 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.363561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.363727 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.363888 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.364050 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.364229 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.365331 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.365501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.365749 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.365932 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.366094 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.366247 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.366420 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.366586 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.366738 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.366738 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.367033 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.367210 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.367374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.367535 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.368061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.368219 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.368504 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.368667 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.368830 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.368997 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.369150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.369301 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.369452 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.369610 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.369777 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.369940 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.370098 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.370261 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.370420 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.370573 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.370755 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.377513 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.377720 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.377895 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.378056 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.378214 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.378386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.378386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.378836 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.379009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.379205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.379370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.382812 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.383011 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.383207 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.383377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.383540 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.383792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.383951 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.384111 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.384264 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.385788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.385976 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.386153 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.386314 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.386469 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.386640 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.386791 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.386952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.387171 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.387341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.387513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.387678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.387839 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.388001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.388164 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.388325 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.388486 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.388684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.388784 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.388871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.388962 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.389056 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.389153 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.389249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.389338 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.389480 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.389601 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.389722 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.389863 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.390006 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.390145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.390292 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.390424 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.390561 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.390681 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.390792 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.390912 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.391028 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.391028 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.391295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.391410 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.391521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.391730 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.391846 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.391967 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.392090 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.392204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.393403 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.394138 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.394269 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.394438 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.394581 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.394708 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.394824 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.394935 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.395046 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.395189 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.395332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.395473 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.395588 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.395722 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.395852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.395967 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.396087 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.396216 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.396339 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.396462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.396574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.396686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.396797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.397100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.397229 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.397351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.397482 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.397599 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.397726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.397852 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.397973 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.398086 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.398197 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.398308 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.398434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.398547 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.398712 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.398845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.398968 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.399124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.399264 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.399387 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.399507 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.399620 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.399740 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.399853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.400007 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.400146 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.400276 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.400414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.400544 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.400685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.400832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.401553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.401676 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.401790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.401915 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.402046 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.402161 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.402273 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.402413 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.402871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.402994 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.403153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.403274 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.403421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.403693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.403821 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.403943 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.404066 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.404190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.404312 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.404434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.404554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.404675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.404787 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.404908 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.405020 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.405139 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.405251 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.405372 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.405484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.405606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.405718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.405829 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.405943 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.406070 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.406192 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.406322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.406435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.406546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.406657 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.406812 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.407179 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.407316 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.407442 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.407561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.407689 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.407804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.407925 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.408046 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.408159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.408277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.408406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.408520 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.408641 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.408828 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.408950 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.409063 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.409188 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.409310 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.409432 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.409553 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.409667 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.409788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.409909 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.410092 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.410223 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.410359 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.410489 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.410633 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.410633 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.410879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.411016 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.411227 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.411342 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.411475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.411598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.411712 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.411831 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.411952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.412073 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.412201 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.412315 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.412427 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.412537 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.412669 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.413139 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.413263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.413376 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.413498 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.413622 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.413899 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.414035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.414159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.414280 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.414401 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.414522 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.414636 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.414636 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.414868 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.414868 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.415159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.415159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.415403 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.415525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.415639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.415759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.415873 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.415873 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416091 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416216 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 13:34:31.416553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.416553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.417431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.417431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.417431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.417431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.417431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.417431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.417431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.417431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.418339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.418339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.418339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.418339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.418339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.418339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.418339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.418339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.419281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.419281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.419281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.419281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.419281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.419281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.419281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.419281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.420440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.420440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.420440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.420440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.420440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.420440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.420440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.420440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.421508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.421508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.421508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.421508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.421508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.421508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.421508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.421508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.422614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.422614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.422614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.422614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.422614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.422614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.422614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.422614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.424337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.424337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.424337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.424337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.424337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.424337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.424337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.424337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.425581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.425581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.425581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.425581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.425581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.425581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.425581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.425581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.426868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.426868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.426868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.426868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.426868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.426868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.426868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.426868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.428030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.428030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.428030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.428030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.428030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.428030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.428030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.428030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.429182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.429182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.429182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.429182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.429182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.429182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.429182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.429182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.430352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.430352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.430352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.430352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.430352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.430352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.430352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.430352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.431581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.431581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.431581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.431581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.431581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.431581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.431581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.431581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.432685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.432685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.432685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.432685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.432685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.432685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.432685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.432685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.434130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.434130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.434130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.434130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.434130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.434130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.434130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.434130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.435576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.435576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.435576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.435576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.435576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.435576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.435576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.435576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.436688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.436688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.436688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.436688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.436688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.436688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.436688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.436688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.437771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.437771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.437771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.437771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.437771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.437771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.437771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.437771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.438853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.438853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.438853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.438853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.438853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.438853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.438853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.438853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.440074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.440074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.440074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.440074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.440074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.440074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.440074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.440074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.441256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.441256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.441256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.441256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.441256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.441256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.441256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.441256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.442440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.442440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.442440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.442440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.442440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.442440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.442440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.442440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.443913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.443913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.443913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.443913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.443913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.443913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.443913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.443913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.445378 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.445378 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.445378 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.445378 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.445378 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.445378 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.445378 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.446460 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.446460 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.446460 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.446891 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.447794 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.447794 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.447794 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.448275 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.448275 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 13:34:31.448569 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 13:34:31.539989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO dbcounter [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Registered counter for database nova_api Aug 08 13:34:31.561220 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_db.sqlalchemy.engines [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:34:31.568970 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writer thread running {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:34:31.601727 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO dbcounter [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Registered counter for database nova_api Aug 08 13:34:31.622300 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_db.sqlalchemy.engines [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:34:31.629124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writer thread running {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:34:31.629295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.context [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1(cell1) {{(pid=124407) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 13:34:31.633465 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:34:31.633922 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:34:31.635523 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:34:31.636252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:34:31.636694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:34:31.638735 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:34:31.640839 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO dbcounter [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Registered counter for database nova_cell0 Aug 08 13:34:31.644969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO dbcounter [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Registered counter for database nova_cell1 Aug 08 13:34:31.652329 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_db.sqlalchemy.engines [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:34:31.654523 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_db.sqlalchemy.engines [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:34:31.659122 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writer thread running {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:34:31.664930 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writer thread running {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:34:31.684534 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.context [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1(cell1) {{(pid=124408) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 13:34:31.688577 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:34:31.689014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:34:31.690616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:34:31.691397 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:34:31.691844 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:34:31.694404 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:34:31.696519 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO dbcounter [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Registered counter for database nova_cell0 Aug 08 13:34:31.700779 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO dbcounter [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Registered counter for database nova_cell1 Aug 08 13:34:31.710363 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_db.sqlalchemy.engines [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:34:31.711209 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_db.sqlalchemy.engines [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:34:31.716103 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writer thread running {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:34:31.803825 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO dbcounter [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Registered counter for database nova_cell0 Aug 08 13:34:31.812298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_db.sqlalchemy.engines [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:34:31.817425 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writer thread running {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:34:31.852139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writer thread running {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:34:31.864155 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO dbcounter [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Registered counter for database nova_cell0 Aug 08 13:34:31.871668 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_db.sqlalchemy.engines [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 13:34:31.876574 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writer thread running {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 13:34:32.134923 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: WARNING keystonemiddleware.auth_token [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 13:34:32.142521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: WARNING keystonemiddleware.auth_token [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 13:34:32.195143 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: WARNING keystonemiddleware.auth_token [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 13:34:32.202600 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: WARNING keystonemiddleware.auth_token [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 13:34:32.496317 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: WARNING keystonemiddleware.auth_token [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 13:34:32.502618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: WARNING keystonemiddleware.auth_token [None req-56c80968-e2a2-432a-8ffc-61357e411a9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 13:34:32.509655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dc2af319c0 pid: 124407 (default app) Aug 08 13:34:32.551154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: WARNING keystonemiddleware.auth_token [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 13:34:32.557384 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: WARNING keystonemiddleware.auth_token [None req-2f2ec58f-e500-4044-b842-fd159932649a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 13:34:32.563790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dc2af319c0 pid: 124408 (default app) Aug 08 13:35:08.172094 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:08.173726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:08.175016 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:08.176008 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:08.482244 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:08.483178 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:08.484047 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:08.486095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:09.681811 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-396c389c-9414-4be9-9a48-f22d267783b9 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Action: 'create', calling method: .version_select at 0x7f7d26216e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-281553973", "metadata": {"Type": "work"}}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-396c389c-9414-4be9-9a48-f22d267783b9 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Request method failure captured: Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 121 Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REMG226rj8q9B-buoqNk-Yrmq9SwEtdtL8kWA_KiPjhtUi2DBS7jYxB31h4PY6EfFfroKd2svtLa9Ti19lZN9tJYGuQ0x5n4jvt57BlNoUHj8EYeqZyLnvodwSivXaZdlNGxOs-f_Mdq55kcdtU15jGZGcWO-9V6Zy2ThX_qVlVNQU Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:35:09.700815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0367800b12d7428b9a58cff37f5fc501"}]}] Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: a6ef5f1cd8e64a86bc691aee50fc699d Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-281553973", "metadata": {"Type": "work"}}} Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: Aug 08 13:35:09.702538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-281553973', 'metadata': {'Type': 'work'}}}} Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise error Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi '#$%' Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:09.703557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 13:35:09.705154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 13:35:09.706525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 13:35:09.706525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:09.706525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-396c389c-9414-4be9-9a48-f22d267783b9 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:09.706525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-396c389c-9414-4be9-9a48-f22d267783b9 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.237399 Aug 08 13:35:09.711889 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Aug 8 13:35:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 13:35:09.718376 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-35a3e077-d193-457d-adf4-2668acb1b44d tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] Action: 'create', calling method: .version_select at 0x7f7d26222dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2112315441", "metadata": {"Type": "work"}}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:09.849572 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2f294f7e-71bb-4959-a6b6-8f90376da339 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Action: 'create', calling method: .version_select at 0x7f7d2612b940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-494979689"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:11.189889 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-35a3e077-d193-457d-adf4-2668acb1b44d tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.029941 Aug 08 13:35:11.191031 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 1/2] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Aug 8 13:35:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3033 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 13:35:11.198081 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d94d88ce-d741-47ff-885a-3565e09845ea tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Action: 'create', calling method: .version_select at 0x7f7d2610fb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-344310558", "metadata": {"Type": "work"}}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d94d88ce-d741-47ff-885a-3565e09845ea tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Request method failure captured: Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 119 Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REMG226rj8q9B-buoqNk-Yrmq9SwEtdtL8kWA_KiPjhtUi2DBS7jYxB31h4PY6EfFfroKd2svtLa9Ti19lZN9tJYGuQ0x5n4jvt57BlNoUHj8EYeqZyLnvodwSivXaZdlNGxOs-f_Mdq55kcdtU15jGZGcWO-9V6Zy2ThX_qVlVNQU Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:35:11.206598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0367800b12d7428b9a58cff37f5fc501"}]}] Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: a6ef5f1cd8e64a86bc691aee50fc699d Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-344310558", "metadata": {"Type": "work"}}} Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: Aug 08 13:35:11.207956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-344310558', 'metadata': {'Type': 'work'}}}} Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise error Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi '0' Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:11.208694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 13:35:11.209998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 13:35:11.213065 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 13:35:11.213065 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.213065 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d94d88ce-d741-47ff-885a-3565e09845ea tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:11.213065 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d94d88ce-d741-47ff-885a-3565e09845ea tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016252 Aug 08 13:35:11.216298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Aug 8 13:35:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 13:35:11.223011 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6ac1d278-238a-4dfb-a198-947272ecf32e tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] Calling method '.version_select at 0x7f7d260695e0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:11.321872 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6ac1d278-238a-4dfb-a198-947272ecf32e tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8" status: 200 len: 353 microversion: 2.1 time: 0.104349 Aug 08 13:35:11.322443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 3/4] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:11 2022] GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:11.328092 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c5dce9b4-cf81-49e8-a3c8-4cdf70db4d6e tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Action: 'create', calling method: .version_select at 0x7f7d260ae700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-914265613", "metadata": {"Type": "work"}}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c5dce9b4-cf81-49e8-a3c8-4cdf70db4d6e tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Request method failure captured: Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 118 Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REMG226rj8q9B-buoqNk-Yrmq9SwEtdtL8kWA_KiPjhtUi2DBS7jYxB31h4PY6EfFfroKd2svtLa9Ti19lZN9tJYGuQ0x5n4jvt57BlNoUHj8EYeqZyLnvodwSivXaZdlNGxOs-f_Mdq55kcdtU15jGZGcWO-9V6Zy2ThX_qVlVNQU Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:35:11.335821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0367800b12d7428b9a58cff37f5fc501"}]}] Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: a6ef5f1cd8e64a86bc691aee50fc699d Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-914265613", "metadata": {"Type": "work"}}} Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: Aug 08 13:35:11.337530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-914265613', 'metadata': {'Type': 'work'}}}} Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise error Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi '' Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:11.338460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 13:35:11.340036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 13:35:11.341414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 13:35:11.341414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.341414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c5dce9b4-cf81-49e8-a3c8-4cdf70db4d6e tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:11.341414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c5dce9b4-cf81-49e8-a3c8-4cdf70db4d6e tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015801 Aug 08 13:35:11.343635 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 4/5] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Aug 8 13:35:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 13:35:11.362187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-11a22c3b-f771-476e-a7f2-70731de2ab58 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Calling method '.version_select at 0x7f7d26069820>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:11.415318 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2f294f7e-71bb-4959-a6b6-8f90376da339 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.705381 Aug 08 13:35:11.416722 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 2/6] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Aug 8 13:35:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1709 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 13:35:11.432128 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-11a22c3b-f771-476e-a7f2-70731de2ab58 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] HTTP exception thrown: Volume tempest-invalid-146756625 could not be found. Aug 08 13:35:11.433796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ff8b3b82-56db-436c-9344-8bbdd7a0ba22 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d26067280>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-11a22c3b-f771-476e-a7f2-70731de2ab58 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Request method failure captured: Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-146756625 HTTP/1.1 Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REMG226rj8q9B-buoqNk-Yrmq9SwEtdtL8kWA_KiPjhtUi2DBS7jYxB31h4PY6EfFfroKd2svtLa9Ti19lZN9tJYGuQ0x5n4jvt57BlNoUHj8EYeqZyLnvodwSivXaZdlNGxOs-f_Mdq55kcdtU15jGZGcWO-9V6Zy2ThX_qVlVNQU Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:35:11.436030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0367800b12d7428b9a58cff37f5fc501"}]}] Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: a6ef5f1cd8e64a86bc691aee50fc699d Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Volume tempest-invalid-146756625 could not be found. Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': 'tempest-invalid-146756625'} Aug 08 13:35:11.437592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-146756625 could not be found. (HTTP 404) (Request-ID: req-ed3ccb51-572d-4c43-8bda-e0c98735eaa1) Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.438416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 13:35:11.439971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-146756625 could not be found. Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:35:11.443711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-146756625 could not be found. Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-146756625 could not be found. Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-11a22c3b-f771-476e-a7f2-70731de2ab58 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Returning 404 to user: Volume tempest-invalid-146756625 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-11a22c3b-f771-476e-a7f2-70731de2ab58 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-146756625" status: 404 len: 98 microversion: 2.1 time: 0.087598 Aug 08 13:35:11.446235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 5/7] 10.222.0.33 () {58 vars in 1215 bytes} [Mon Aug 8 13:35:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-146756625 => generated 98 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 08 13:35:11.457801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3568ffc9-619a-4757-af6d-4ec7863754d4 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009168 Aug 08 13:35:11.463738 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 6/8] 10.222.0.33 () {58 vars in 1140 bytes} [Mon Aug 8 13:35:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 13:35:11.477248 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-cc6a3bcb-1c89-44bb-954f-8bc811f1dda6 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009789 Aug 08 13:35:11.483697 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 7/9] 10.222.0.33 () {58 vars in 1137 bytes} [Mon Aug 8 13:35:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 13:35:11.507263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b6807a07-6f2f-4a0e-b6d2-f68ba8078047 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Calling method '.version_select at 0x7f7d26069e50>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:11.565087 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-b6807a07-6f2f-4a0e-b6d2-f68ba8078047 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] HTTP exception thrown: Volume 21291645-1ac5-4003-9b8e-cea3023f98c7 could not be found. Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b6807a07-6f2f-4a0e-b6d2-f68ba8078047 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Request method failure captured: Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/os-volumes/21291645-1ac5-4003-9b8e-cea3023f98c7 HTTP/1.1 Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REMG226rj8q9B-buoqNk-Yrmq9SwEtdtL8kWA_KiPjhtUi2DBS7jYxB31h4PY6EfFfroKd2svtLa9Ti19lZN9tJYGuQ0x5n4jvt57BlNoUHj8EYeqZyLnvodwSivXaZdlNGxOs-f_Mdq55kcdtU15jGZGcWO-9V6Zy2ThX_qVlVNQU Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:35:11.572189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0367800b12d7428b9a58cff37f5fc501"}]}] Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: a6ef5f1cd8e64a86bc691aee50fc699d Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Volume 21291645-1ac5-4003-9b8e-cea3023f98c7 could not be found. Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '21291645-1ac5-4003-9b8e-cea3023f98c7'} Aug 08 13:35:11.573797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 21291645-1ac5-4003-9b8e-cea3023f98c7 could not be found. (HTTP 404) (Request-ID: req-0509e4c3-d8b3-4b4d-a2c5-1c64de20e510) Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.574591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 13:35:11.575931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 21291645-1ac5-4003-9b8e-cea3023f98c7 could not be found. Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 13:35:11.577044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 21291645-1ac5-4003-9b8e-cea3023f98c7 could not be found. Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 21291645-1ac5-4003-9b8e-cea3023f98c7 could not be found. Aug 08 13:35:11.590969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.592491 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ff8b3b82-56db-436c-9344-8bbdd7a0ba22 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312" status: 200 len: 344 microversion: 2.1 time: 0.150086 Aug 08 13:35:11.592491 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 3/10] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:11 2022] GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:35:11.592798 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b6807a07-6f2f-4a0e-b6d2-f68ba8078047 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Returning 404 to user: Volume 21291645-1ac5-4003-9b8e-cea3023f98c7 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:11.592798 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b6807a07-6f2f-4a0e-b6d2-f68ba8078047 tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/21291645-1ac5-4003-9b8e-cea3023f98c7" status: 404 len: 109 microversion: 2.1 time: 0.091255 Aug 08 13:35:11.592798 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 8/11] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 13:35:11 2022] DELETE /compute/v2.1/os-volumes/21291645-1ac5-4003-9b8e-cea3023f98c7 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:35:11.599107 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d0c3ffaf-f22c-4e79-9fe6-52ded36c53fc tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Calling method '.version_select at 0x7f7d26067940>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:11.664973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-d0c3ffaf-f22c-4e79-9fe6-52ded36c53fc tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] HTTP exception thrown: Volume 7021a578-c3c0-4b95-9a21-472ed24ba0e4 could not be found. Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d0c3ffaf-f22c-4e79-9fe6-52ded36c53fc tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Request method failure captured: Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/os-volumes/7021a578-c3c0-4b95-9a21-472ed24ba0e4 HTTP/1.1 Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REMG226rj8q9B-buoqNk-Yrmq9SwEtdtL8kWA_KiPjhtUi2DBS7jYxB31h4PY6EfFfroKd2svtLa9Ti19lZN9tJYGuQ0x5n4jvt57BlNoUHj8EYeqZyLnvodwSivXaZdlNGxOs-f_Mdq55kcdtU15jGZGcWO-9V6Zy2ThX_qVlVNQU Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:35:11.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0367800b12d7428b9a58cff37f5fc501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0367800b12d7428b9a58cff37f5fc501"}]}] Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 0367800b12d7428b9a58cff37f5fc501 Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-VolumesNegativeTest-1991686273 Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: a6ef5f1cd8e64a86bc691aee50fc699d Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-VolumesNegativeTest-1991686273-project Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Volume 7021a578-c3c0-4b95-9a21-472ed24ba0e4 could not be found. Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '7021a578-c3c0-4b95-9a21-472ed24ba0e4'} Aug 08 13:35:11.670322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7021a578-c3c0-4b95-9a21-472ed24ba0e4 could not be found. (HTTP 404) (Request-ID: req-ff22b4c2-5b5d-403e-8b22-7470e7dc647b) Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.671153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 13:35:11.672295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7021a578-c3c0-4b95-9a21-472ed24ba0e4 could not be found. Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 13:35:11.675793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7021a578-c3c0-4b95-9a21-472ed24ba0e4 could not be found. Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7021a578-c3c0-4b95-9a21-472ed24ba0e4 could not be found. Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d0c3ffaf-f22c-4e79-9fe6-52ded36c53fc tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] Returning 404 to user: Volume 7021a578-c3c0-4b95-9a21-472ed24ba0e4 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:11.678329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d0c3ffaf-f22c-4e79-9fe6-52ded36c53fc tempest-VolumesNegativeTest-1991686273 tempest-VolumesNegativeTest-1991686273-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7021a578-c3c0-4b95-9a21-472ed24ba0e4" status: 404 len: 109 microversion: 2.1 time: 0.079159 Aug 08 13:35:11.680103 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 4/12] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:11 2022] GET /compute/v2.1/os-volumes/7021a578-c3c0-4b95-9a21-472ed24ba0e4 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:35:12.337188 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c170efee-bbc6-49c8-b337-c07bececc1a1 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] Calling method '.version_select at 0x7f7d26069310>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:12.414121 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c170efee-bbc6-49c8-b337-c07bececc1a1 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8" status: 200 len: 353 microversion: 2.1 time: 0.081062 Aug 08 13:35:12.415386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 9/13] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:12 2022] GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:12.601681 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-05998bba-340f-42dc-a801-288e6af34776 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d26027940>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:12.737964 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-05998bba-340f-42dc-a801-288e6af34776 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312" status: 200 len: 344 microversion: 2.1 time: 0.147872 Aug 08 13:35:12.744812 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 5/14] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:12 2022] GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:13.450678 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-18350c77-ef84-422d-9c29-ef17c2ed861b tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] Calling method '.version_select at 0x7f7d26069280>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:13.711847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-18350c77-ef84-422d-9c29-ef17c2ed861b tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8" status: 200 len: 354 microversion: 2.1 time: 0.287076 Aug 08 13:35:13.713188 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 10/15] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:13 2022] GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8 => generated 354 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:13.727341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-646d01ff-e213-4ec8-8a77-92be898c9a25 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] Calling method '.version_select at 0x7f7d2603c040>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:13.769729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c52318ce-9761-4e82-a834-7863bd0fcbe8 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d260761f0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:13.817597 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-646d01ff-e213-4ec8-8a77-92be898c9a25 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8" status: 200 len: 354 microversion: 2.1 time: 0.095695 Aug 08 13:35:13.832705 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 6/16] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:13 2022] GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8 => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:13.838851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-24664559-78e4-43dc-9ef4-0f03d9dbeb34 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] Calling method '.version_select at 0x7f7d26027b80>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:13.889142 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c52318ce-9761-4e82-a834-7863bd0fcbe8 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312" status: 200 len: 345 microversion: 2.1 time: 0.140894 Aug 08 13:35:13.890422 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 11/17] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:13 2022] GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312 => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:13.906657 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c4d98f01-f5a0-42d4-a751-03c7ef560429 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Action: 'create', calling method: .version_select at 0x7f7d260768b0>, body: {"snapshot": {"volume_id": "2a929bcd-cf90-47bd-ac6e-d1318c61d312", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1415868676"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:14.001363 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-24664559-78e4-43dc-9ef4-0f03d9dbeb34 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8" status: 202 len: 0 microversion: 2.1 time: 0.167135 Aug 08 13:35:14.001944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 7/18] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 13:35:13 2022] DELETE /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:35:14.010341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6dc5dde7-85a5-4d97-b5d5-d192d69636ec tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] Calling method '.version_select at 0x7f7d26a23040>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:14.108768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6dc5dde7-85a5-4d97-b5d5-d192d69636ec tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8" status: 200 len: 353 microversion: 2.1 time: 0.102528 Aug 08 13:35:14.109643 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 8/19] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:14 2022] GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:35:14.355869 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c4d98f01-f5a0-42d4-a751-03c7ef560429 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.456818 Aug 08 13:35:14.362405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 12/20] 10.222.0.33 () {60 vars in 1162 bytes} [Mon Aug 8 13:35:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:35:14.368510 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2827b05a-9a11-4dff-8a22-61993da21fc6 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d2603c280>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:14.556724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2827b05a-9a11-4dff-8a22-61993da21fc6 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 200 len: 287 microversion: 2.1 time: 0.192518 Aug 08 13:35:14.557871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 9/21] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 13:35:14 2022] GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:14.572592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-87dff6ee-7c6f-4944-90a6-2d22404d11c9 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d26076af0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:14.938645 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-87dff6ee-7c6f-4944-90a6-2d22404d11c9 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.373302 Aug 08 13:35:14.950762 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 13/22] 10.222.0.33 () {58 vars in 1140 bytes} [Mon Aug 8 13:35:14 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:14.954355 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a19f5b3e-af97-457c-9911-5cc387bf96eb tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d260273a0>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:15.035900 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a19f5b3e-af97-457c-9911-5cc387bf96eb tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 200 len: 287 microversion: 2.1 time: 0.084752 Aug 08 13:35:15.038457 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 10/23] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 13:35:14 2022] GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:15.127741 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c6bf3056-9ea3-48d3-910a-cec0b0205c10 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] Calling method '.version_select at 0x7f7d26069040>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:15.212680 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-c6bf3056-9ea3-48d3-910a-cec0b0205c10 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] HTTP exception thrown: Volume d1aa9692-c49b-4be0-841a-4c3087590df8 could not be found. Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c6bf3056-9ea3-48d3-910a-cec0b0205c10 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] Request method failure captured: Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8 HTTP/1.1 Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REMMSnr7wUoxwnKXTDV8zij3_EdTqBvMoeB3Th5V6ef-_Vinj4O1q9cdS6TOzT62qrfd0uTNDmeajYwZ8x2eYvybPfs1QQ4ApxY0hZ4kpEzMOY1n7NitqkK1OgSHcsaP2motIq9t0bsJm6QJXCG8hIcqKDrHaiZG8rJuKkdaQGCKZg Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: a3935a3e3fce40d7a936c74f38002fec Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-VolumesGetTestJSON-2069766324 Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:35:15.215675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3935a3e3fce40d7a936c74f38002fec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3935a3e3fce40d7a936c74f38002fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3935a3e3fce40d7a936c74f38002fec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3935a3e3fce40d7a936c74f38002fec"}]}] Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-VolumesGetTestJSON-2069766324 Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: a3935a3e3fce40d7a936c74f38002fec Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-VolumesGetTestJSON-2069766324 Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-VolumesGetTestJSON-2069766324-project Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: fa4870e52d734e64a2e07f82a4b59c71 Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-VolumesGetTestJSON-2069766324-project Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Volume d1aa9692-c49b-4be0-841a-4c3087590df8 could not be found. Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': 'd1aa9692-c49b-4be0-841a-4c3087590df8'} Aug 08 13:35:15.217732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1aa9692-c49b-4be0-841a-4c3087590df8 could not be found. (HTTP 404) (Request-ID: req-2c109d6f-6483-4bea-a656-787a44e3eb5d) Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:15.218451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 13:35:15.219651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1aa9692-c49b-4be0-841a-4c3087590df8 could not be found. Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 13:35:15.220787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1aa9692-c49b-4be0-841a-4c3087590df8 could not be found. Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1aa9692-c49b-4be0-841a-4c3087590df8 could not be found. Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c6bf3056-9ea3-48d3-910a-cec0b0205c10 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] Returning 404 to user: Volume d1aa9692-c49b-4be0-841a-4c3087590df8 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:15.221988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c6bf3056-9ea3-48d3-910a-cec0b0205c10 tempest-VolumesGetTestJSON-2069766324 tempest-VolumesGetTestJSON-2069766324-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8" status: 404 len: 109 microversion: 2.1 time: 0.100575 Aug 08 13:35:15.223456 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 14/24] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:15 2022] GET /compute/v2.1/os-volumes/d1aa9692-c49b-4be0-841a-4c3087590df8 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:35:16.048869 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-eba1a6b4-e6ce-4a18-8be4-1aa6f740e009 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d260278b0>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:16.301847 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-eba1a6b4-e6ce-4a18-8be4-1aa6f740e009 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 200 len: 287 microversion: 2.1 time: 0.256674 Aug 08 13:35:16.304849 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 11/25] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 13:35:16 2022] GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 287 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:17.318100 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2b67e497-00b2-478c-bb9b-1f452ca574f2 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d2610faf0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:17.369379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2b67e497-00b2-478c-bb9b-1f452ca574f2 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 200 len: 287 microversion: 2.1 time: 0.055623 Aug 08 13:35:17.371172 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 15/26] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 13:35:17 2022] GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:18.174581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-459893749", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "networks": [{"uuid": "ab239a18-b487-40fc-873c-4e72bb7c468f"}]}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:18.399879 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-43111bb1-ee91-4127-96ec-bce0d608490d tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d260764c0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:18.408698 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] validate_networks() for [('ab239a18-b487-40fc-873c-4e72bb7c468f', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:35:18.460001 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-43111bb1-ee91-4127-96ec-bce0d608490d tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 200 len: 287 microversion: 2.1 time: 0.081697 Aug 08 13:35:18.460961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 16/27] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 13:35:18 2022] GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:19.474117 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b625f61c-048e-4919-b3ea-6ec621a5bc33 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d2606b040>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:19.553717 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b625f61c-048e-4919-b3ea-6ec621a5bc33 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 200 len: 287 microversion: 2.1 time: 0.084512 Aug 08 13:35:19.559038 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 17/28] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 13:35:19 2022] GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:35:20.567512 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f85318e8-290a-44df-8423-ca3f70b14afe tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d2606b700>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:20.628414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f85318e8-290a-44df-8423-ca3f70b14afe tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 200 len: 287 microversion: 2.1 time: 0.065042 Aug 08 13:35:20.629790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 18/29] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 13:35:20 2022] GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:35:21.641768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7eedf28c-2fc3-4c68-8e8e-3f9d8eb0d283 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d2606bdc0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:21.738874 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7eedf28c-2fc3-4c68-8e8e-3f9d8eb0d283 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 200 len: 288 microversion: 2.1 time: 0.099912 Aug 08 13:35:21.747614 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 19/30] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 13:35:21 2022] GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:21.753482 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6ec5fc30-526a-4fc4-81ab-8cfc93b3b8ac tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d2606b8b0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:21.906934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6ec5fc30-526a-4fc4-81ab-8cfc93b3b8ac tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 202 len: 0 microversion: 2.1 time: 0.157830 Aug 08 13:35:21.908063 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 20/31] 10.222.0.33 () {58 vars in 1254 bytes} [Mon Aug 8 13:35:21 2022] DELETE /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:35:21.918491 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6097849b-70c8-4f96-9bca-294852f8f6ca tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d2606b1f0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:21.995830 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6097849b-70c8-4f96-9bca-294852f8f6ca tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 200 len: 287 microversion: 2.1 time: 0.082748 Aug 08 13:35:21.996415 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 21/32] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 13:35:21 2022] GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:23.011992 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-70a7fad6-1473-4e6d-9473-7ee8b96e38d9 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d260769d0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:23.087010 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-70a7fad6-1473-4e6d-9473-7ee8b96e38d9 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] HTTP exception thrown: Snapshot 23b42761-4376-4afd-a4cb-41473e99f838 could not be found. Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-70a7fad6-1473-4e6d-9473-7ee8b96e38d9 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Request method failure captured: Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 HTTP/1.1 Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REMEEtddOyOmWaW-51C9UvevyNRwIV3xEnlLy-2dTvSpAstZTAuaiJfMfD3nqUGYNZwKFb8WER752ZYo24ckCI50M2rvpCRh9OMLuoTfT82TpKDHbkHWQMRZb21B95iArAL4eInzVm2a9o3BxNm1c3lESN9CGLH4SqYPqZAyThLptY Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 7443e956a2d7470f878fcb96a99e6e40 Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:35:23.091374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7443e956a2d7470f878fcb96a99e6e40"}]}] Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 7443e956a2d7470f878fcb96a99e6e40 Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-VolumesSnapshotsTestJSON-1608288791-project Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: f1a885a2de8e4af4b7ec02a52458ebc0 Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1608288791-project Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Snapshot 23b42761-4376-4afd-a4cb-41473e99f838 could not be found. Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '23b42761-4376-4afd-a4cb-41473e99f838'} Aug 08 13:35:23.092742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 23b42761-4376-4afd-a4cb-41473e99f838 could not be found. (HTTP 404) (Request-ID: req-c1d560f6-9e44-4c6e-aff8-d9a61c7d0e24) Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:23.093405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 13:35:23.094263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 23b42761-4376-4afd-a4cb-41473e99f838 could not be found. Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 08 13:35:23.095181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 23b42761-4376-4afd-a4cb-41473e99f838 could not be found. Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 23b42761-4376-4afd-a4cb-41473e99f838 could not be found. Aug 08 13:35:23.096287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:23.098737 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-70a7fad6-1473-4e6d-9473-7ee8b96e38d9 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Returning 404 to user: Snapshot 23b42761-4376-4afd-a4cb-41473e99f838 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:23.099993 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-70a7fad6-1473-4e6d-9473-7ee8b96e38d9 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838" status: 404 len: 111 microversion: 2.1 time: 0.094705 Aug 08 13:35:23.100834 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 22/33] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 13:35:23 2022] GET /compute/v2.1/os-snapshots/23b42761-4376-4afd-a4cb-41473e99f838 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 13:35:23.130273 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0d53d906-9e77-4b5f-9877-788cf231928a tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d2606ba60>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:23.312004 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0d53d906-9e77-4b5f-9877-788cf231928a tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312" status: 202 len: 0 microversion: 2.1 time: 0.205515 Aug 08 13:35:23.318796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 23/34] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 13:35:23 2022] DELETE /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:35:23.718217 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:35:23.719091 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:35:23.720221 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:35:23.721266 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:35:23.722193 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:35:23.745734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b6d0eef3-a298-41f1-a4cd-ce133fe4b315 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: .version_select at 0x7f7d26076c10>, body: {"keypair": {"name": "tempest-keypair-967042771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoN9Yfy6EdJDPbfwxKGL4fmfONQkvwu6iCPiZ1mgPGxAHM7e1yzisK6LYL9Lkfp/ntqPub1mCa4al7xzeyoJh9rbGvuIkpl6lIaHiLkXa4axpgE3koEnA+top+l10z/7w=="}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:23.863697 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:23.864983 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:23.865956 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:23.867994 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:23.869559 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:23.870571 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:23.940481 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Getting quotas for project 5021d13535274fa2b44666c8d39080bf. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:35:23.954489 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Getting quotas for user c93191a5e3c7476f926b56424ccec4ba and project 5021d13535274fa2b44666c8d39080bf. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:35:23.985639 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:35:23.993039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:35:24.004720 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-b6d0eef3-a298-41f1-a4cd-ce133fe4b315 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:35:24.033737 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-b6d0eef3-a298-41f1-a4cd-ce133fe4b315 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for user fce6a7d7dbc94adeb0b03bae34e335a0 and project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:35:24.210736 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b6d0eef3-a298-41f1-a4cd-ce133fe4b315 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.888797 Aug 08 13:35:24.211899 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 24/35] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 13:35:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:24.226987 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7437e051-796f-461a-af8a-049b63ae2472 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d25fa09d0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:24.234355 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-327eb856-e8b7-4f50-b92d-8f224b56c7e7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.371773 Aug 08 13:35:24.235726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 12/36] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:35:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 6374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:35:24.249993 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b37b0224-41c8-4e00-a3b4-a070e46765a0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:24.250635 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b37b0224-41c8-4e00-a3b4-a070e46765a0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:24.332383 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-7437e051-796f-461a-af8a-049b63ae2472 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] HTTP exception thrown: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7437e051-796f-461a-af8a-049b63ae2472 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Request method failure captured: Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312 HTTP/1.1 Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REMEEtddOyOmWaW-51C9UvevyNRwIV3xEnlLy-2dTvSpAstZTAuaiJfMfD3nqUGYNZwKFb8WER752ZYo24ckCI50M2rvpCRh9OMLuoTfT82TpKDHbkHWQMRZb21B95iArAL4eInzVm2a9o3BxNm1c3lESN9CGLH4SqYPqZAyThLptY Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 7443e956a2d7470f878fcb96a99e6e40 Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:35:24.336538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7443e956a2d7470f878fcb96a99e6e40"}]}] Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 7443e956a2d7470f878fcb96a99e6e40 Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-VolumesSnapshotsTestJSON-1608288791-project Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: f1a885a2de8e4af4b7ec02a52458ebc0 Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1608288791-project Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '2a929bcd-cf90-47bd-ac6e-d1318c61d312'} Aug 08 13:35:24.338928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. (HTTP 404) (Request-ID: req-e2e9397a-e806-4f84-862e-0fdc7b808575) Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:24.340322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 13:35:24.343786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 13:35:24.345729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.347768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.351109 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7437e051-796f-461a-af8a-049b63ae2472 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Returning 404 to user: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:24.360183 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7437e051-796f-461a-af8a-049b63ae2472 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312" status: 404 len: 109 microversion: 2.1 time: 0.144638 Aug 08 13:35:24.361880 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 25/37] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:24 2022] GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:35:24.394793 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7daf9c92-a1d6-48ab-b946-ce3f1fa076c1 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d25752d30>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:24.469079 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-7daf9c92-a1d6-48ab-b946-ce3f1fa076c1 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] HTTP exception thrown: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7daf9c92-a1d6-48ab-b946-ce3f1fa076c1 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Request method failure captured: Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312 HTTP/1.1 Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REMEEtddOyOmWaW-51C9UvevyNRwIV3xEnlLy-2dTvSpAstZTAuaiJfMfD3nqUGYNZwKFb8WER752ZYo24ckCI50M2rvpCRh9OMLuoTfT82TpKDHbkHWQMRZb21B95iArAL4eInzVm2a9o3BxNm1c3lESN9CGLH4SqYPqZAyThLptY Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 7443e956a2d7470f878fcb96a99e6e40 Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:35:24.472946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7443e956a2d7470f878fcb96a99e6e40"}]}] Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 7443e956a2d7470f878fcb96a99e6e40 Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-VolumesSnapshotsTestJSON-1608288791-project Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: f1a885a2de8e4af4b7ec02a52458ebc0 Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1608288791-project Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '2a929bcd-cf90-47bd-ac6e-d1318c61d312'} Aug 08 13:35:24.474191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. (HTTP 404) (Request-ID: req-f6046195-54a2-4594-b40d-b3c4719ec4e7) Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:24.474910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 13:35:24.476429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 13:35:24.483801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7daf9c92-a1d6-48ab-b946-ce3f1fa076c1 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Returning 404 to user: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7daf9c92-a1d6-48ab-b946-ce3f1fa076c1 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312" status: 404 len: 109 microversion: 2.1 time: 0.096392 Aug 08 13:35:24.484945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 26/38] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 13:35:24 2022] DELETE /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:35:24.497963 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-704650c9-7cd4-46c5-bb10-571733867430 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Calling method '.version_select at 0x7f7d257525e0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:24.588164 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-704650c9-7cd4-46c5-bb10-571733867430 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] HTTP exception thrown: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-704650c9-7cd4-46c5-bb10-571733867430 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Request method failure captured: Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312 HTTP/1.1 Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REMEEtddOyOmWaW-51C9UvevyNRwIV3xEnlLy-2dTvSpAstZTAuaiJfMfD3nqUGYNZwKFb8WER752ZYo24ckCI50M2rvpCRh9OMLuoTfT82TpKDHbkHWQMRZb21B95iArAL4eInzVm2a9o3BxNm1c3lESN9CGLH4SqYPqZAyThLptY Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 7443e956a2d7470f878fcb96a99e6e40 Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:35:24.592077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7443e956a2d7470f878fcb96a99e6e40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7443e956a2d7470f878fcb96a99e6e40"}]}] Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 7443e956a2d7470f878fcb96a99e6e40 Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1608288791 Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-VolumesSnapshotsTestJSON-1608288791-project Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: f1a885a2de8e4af4b7ec02a52458ebc0 Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1608288791-project Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '2a929bcd-cf90-47bd-ac6e-d1318c61d312'} Aug 08 13:35:24.594406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. (HTTP 404) (Request-ID: req-012c277d-af23-4670-8800-e1e25c85b770) Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:24.595847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 13:35:24.598431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 13:35:24.605066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:35:24.609804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-704650c9-7cd4-46c5-bb10-571733867430 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] Returning 404 to user: Volume 2a929bcd-cf90-47bd-ac6e-d1318c61d312 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:35:24.620538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-704650c9-7cd4-46c5-bb10-571733867430 tempest-VolumesSnapshotsTestJSON-1608288791 tempest-VolumesSnapshotsTestJSON-1608288791-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312" status: 404 len: 109 microversion: 2.1 time: 0.121041 Aug 08 13:35:24.622586 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 27/39] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:35:24 2022] GET /compute/v2.1/os-volumes/2a929bcd-cf90-47bd-ac6e-d1318c61d312 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:35:25.203742 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b37b0224-41c8-4e00-a3b4-a070e46765a0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:25.307559 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b37b0224-41c8-4e00-a3b4-a070e46765a0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1214 microversion: 2.1 time: 1.062021 Aug 08 13:35:25.339328 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 13/40] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:24 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1214 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:26.348654 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d617ba12-d5dd-4d5f-9bea-ceda71c4b1c5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:26.354789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d617ba12-d5dd-4d5f-9bea-ceda71c4b1c5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:26.936453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d617ba12-d5dd-4d5f-9bea-ceda71c4b1c5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:26.960341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d617ba12-d5dd-4d5f-9bea-ceda71c4b1c5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1214 microversion: 2.1 time: 0.620759 Aug 08 13:35:26.961735 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 28/41] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:26 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1214 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:35:28.001784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-78bc1588-3747-43b5-9f72-202db82d55d1 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:28.002968 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-78bc1588-3747-43b5-9f72-202db82d55d1 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:28.050142 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-78bc1588-3747-43b5-9f72-202db82d55d1 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:28.052905 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-78bc1588-3747-43b5-9f72-202db82d55d1 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:28.053650 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-78bc1588-3747-43b5-9f72-202db82d55d1 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:28.054957 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-78bc1588-3747-43b5-9f72-202db82d55d1 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:28.056396 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-78bc1588-3747-43b5-9f72-202db82d55d1 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:28.059857 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-78bc1588-3747-43b5-9f72-202db82d55d1 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:29.241831 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-19537324", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:29.414517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] validate_networks() for [('b2d7ae95-a7a1-43c7-a098-10d1941cdbb9', None, None, None, None, None)] {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:35:29.581328 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-78bc1588-3747-43b5-9f72-202db82d55d1 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:29.605668 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-78bc1588-3747-43b5-9f72-202db82d55d1 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1266 microversion: 2.1 time: 1.612689 Aug 08 13:35:29.614024 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 14/42] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:27 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1266 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:30.654446 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4b924678-5609-462c-a087-971fbad21e8f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:30.655204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4b924678-5609-462c-a087-971fbad21e8f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:30.677163 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b924678-5609-462c-a087-971fbad21e8f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:30.677677 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b924678-5609-462c-a087-971fbad21e8f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:30.678117 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b924678-5609-462c-a087-971fbad21e8f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:30.696767 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b924678-5609-462c-a087-971fbad21e8f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:30.697522 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b924678-5609-462c-a087-971fbad21e8f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:30.697984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b924678-5609-462c-a087-971fbad21e8f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:31.012448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4b924678-5609-462c-a087-971fbad21e8f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:31.021885 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4b924678-5609-462c-a087-971fbad21e8f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1272 microversion: 2.1 time: 0.372173 Aug 08 13:35:31.029869 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 15/43] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:30 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1272 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:32.314975 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-77d063af-1c08-4df7-a780-c1d21ccaf754 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'create', calling method: .version_select at 0x7f7d24e1eaf0>, body: {"keypair": {"name": "tempest-keypair-1180825876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR8zvtgdrw2v1qazP6adPnxf/Rd3kjokVgwDkfP/enVCXUycnXdZSzsBwXix54yoRA8Pdq0z2eJVb3wUvXfVLx2a3bAChmsUl/dX8oKjlzr9mhMrp4tVAlAAjtS0zGTmQ=="}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:32.459102 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-77d063af-1c08-4df7-a780-c1d21ccaf754 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Getting quotas for project 643240773a5840d3af2622469d696beb. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:35:32.470220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-77d063af-1c08-4df7-a780-c1d21ccaf754 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Getting quotas for user 651659e941044454985b2f866b791b07 and project 643240773a5840d3af2622469d696beb. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:35:32.588447 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-77d063af-1c08-4df7-a780-c1d21ccaf754 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.551720 Aug 08 13:35:32.604625 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 16/44] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 13:35:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:32.637259 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a3bbfc47-1671-4e31-b05a-a19fb9e862fc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:32.640482 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a3bbfc47-1671-4e31-b05a-a19fb9e862fc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:32.675063 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3bbfc47-1671-4e31-b05a-a19fb9e862fc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:32.678398 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3bbfc47-1671-4e31-b05a-a19fb9e862fc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:32.679583 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3bbfc47-1671-4e31-b05a-a19fb9e862fc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:32.683071 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3bbfc47-1671-4e31-b05a-a19fb9e862fc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:32.692173 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3bbfc47-1671-4e31-b05a-a19fb9e862fc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:32.692629 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3bbfc47-1671-4e31-b05a-a19fb9e862fc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:33.908015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:35.289244 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a3bbfc47-1671-4e31-b05a-a19fb9e862fc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:35.328664 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a3bbfc47-1671-4e31-b05a-a19fb9e862fc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 2.703128 Aug 08 13:35:35.363803 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 17/45] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:32 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 2758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:35.985351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:35:35.987233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:35:35.988377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:35:35.989435 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:35:35.990386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:35:36.130912 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:36.134010 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:36.135319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:36.141506 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:36.143334 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:36.150227 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:36.269391 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Getting quotas for project f90db8c721374e0fb3a037661b3d9fe0. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:35:36.290151 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Getting quotas for user 518d6948777944fd8214dc6d778a9a02 and project f90db8c721374e0fb3a037661b3d9fe0. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:35:36.338506 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:35:36.351193 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:35:36.370199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-94e75bb5-fc6f-4194-8706-c89a1a439763 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:36.377207 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-94e75bb5-fc6f-4194-8706-c89a1a439763 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:36.415210 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94e75bb5-fc6f-4194-8706-c89a1a439763 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:36.422683 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94e75bb5-fc6f-4194-8706-c89a1a439763 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:36.426429 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94e75bb5-fc6f-4194-8706-c89a1a439763 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:36.434846 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94e75bb5-fc6f-4194-8706-c89a1a439763 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:36.435964 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94e75bb5-fc6f-4194-8706-c89a1a439763 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:36.445990 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94e75bb5-fc6f-4194-8706-c89a1a439763 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:36.609987 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-09043ec2-382a-4d72-9084-1cfec4f01301 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.479133 Aug 08 13:35:36.611377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 29/46] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:35:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 8485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:35:36.661714 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3dc8b9cc-37e2-43bc-8f9e-f8bb941e32c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:36.662856 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3dc8b9cc-37e2-43bc-8f9e-f8bb941e32c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:38.588887 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3dc8b9cc-37e2-43bc-8f9e-f8bb941e32c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:38.605308 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3dc8b9cc-37e2-43bc-8f9e-f8bb941e32c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1220 microversion: 2.1 time: 1.964362 Aug 08 13:35:38.609227 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 30/47] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:36 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1220 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:39.128975 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-424056155", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:39.454444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] validate_networks() for [('b2d7ae95-a7a1-43c7-a098-10d1941cdbb9', None, None, None, None, None)] {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:35:40.175941 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-94e75bb5-fc6f-4194-8706-c89a1a439763 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:40.202788 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-94e75bb5-fc6f-4194-8706-c89a1a439763 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 3.835606 Aug 08 13:35:40.205179 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 18/48] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:36 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 3841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:35:40.799698 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-5b648ae6-9d04-439a-8c66-a2ad4d31ebfb req-4ca1cbd8-46af-4c3c-9ad0-883434771256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488cdad7-8bac-4f8a-b412-851f6f2486a3", "tag": "9eb1a549-51fa-449c-98c1-c9211fba91ec"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:40.822548 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:40.874413 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-5b648ae6-9d04-439a-8c66-a2ad4d31ebfb req-4ca1cbd8-46af-4c3c-9ad0-883434771256 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:40.875069 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-5b648ae6-9d04-439a-8c66-a2ad4d31ebfb req-4ca1cbd8-46af-4c3c-9ad0-883434771256 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:40.875548 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-5b648ae6-9d04-439a-8c66-a2ad4d31ebfb req-4ca1cbd8-46af-4c3c-9ad0-883434771256 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:40.956368 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-5b648ae6-9d04-439a-8c66-a2ad4d31ebfb req-4ca1cbd8-46af-4c3c-9ad0-883434771256 service nova] Creating event network-changed:9eb1a549-51fa-449c-98c1-c9211fba91ec for instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 on hv-cinder-85199 Aug 08 13:35:40.956368 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-5b648ae6-9d04-439a-8c66-a2ad4d31ebfb req-4ca1cbd8-46af-4c3c-9ad0-883434771256 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 13:35:40.956368 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-5b648ae6-9d04-439a-8c66-a2ad4d31ebfb req-4ca1cbd8-46af-4c3c-9ad0-883434771256 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 13:35:40.956368 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b3b4f464-89e4-42e9-9980-ecf44d66fc12 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:40.956368 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b3b4f464-89e4-42e9-9980-ecf44d66fc12 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:40.971309 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b3b4f464-89e4-42e9-9980-ecf44d66fc12 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:40.977854 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b3b4f464-89e4-42e9-9980-ecf44d66fc12 None None] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:40.978224 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b3b4f464-89e4-42e9-9980-ecf44d66fc12 None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:40.979027 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b3b4f464-89e4-42e9-9980-ecf44d66fc12 None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:41.022958 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.compute.rpcapi [None req-b3b4f464-89e4-42e9-9980-ecf44d66fc12 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 13:35:41.030092 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b3b4f464-89e4-42e9-9980-ecf44d66fc12 None None] Releasing lock "compute-rpcapi-router" {{(pid=124408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 13:35:41.091548 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b3b4f464-89e4-42e9-9980-ecf44d66fc12 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.881694 Aug 08 13:35:41.094040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 19/49] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:41.133293 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1571736731", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96099fae-9cab-447b-98a0-f55f4a95af9e"}], "security_groups": [{"name": "tempest-securitygroup--560614696"}], "key_name": "tempest-keypair-967042771", "user_data": "}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:42.492927 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=12 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:42.571270 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] validate_networks() for [('96099fae-9cab-447b-98a0-f55f4a95af9e', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:35:44.432856 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:35:44.434057 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:35:44.434549 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:35:44.434965 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:35:44.435444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:35:44.472883 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:44.473376 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:44.473819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:44.474585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:44.475045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:44.475506 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:44.553775 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Getting quotas for project f90db8c721374e0fb3a037661b3d9fe0. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:35:44.559269 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Getting quotas for user 518d6948777944fd8214dc6d778a9a02 and project f90db8c721374e0fb3a037661b3d9fe0. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:35:44.595279 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:35:44.598442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:35:44.735329 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-19831d42-2fab-4dd6-a6d7-64645c346796 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.611806 Aug 08 13:35:44.744032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 31/50] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:35:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 5621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 13:35:44.754312 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-639d3534-152f-4f20-997c-1a4f54197731 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:44.755298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-639d3534-152f-4f20-997c-1a4f54197731 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:44.773612 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-639d3534-152f-4f20-997c-1a4f54197731 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:44.774509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-639d3534-152f-4f20-997c-1a4f54197731 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:44.777469 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-639d3534-152f-4f20-997c-1a4f54197731 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:44.778603 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-639d3534-152f-4f20-997c-1a4f54197731 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:44.783959 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-639d3534-152f-4f20-997c-1a4f54197731 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:44.784891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-639d3534-152f-4f20-997c-1a4f54197731 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:45.901551 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-639d3534-152f-4f20-997c-1a4f54197731 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:45.931724 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-639d3534-152f-4f20-997c-1a4f54197731 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 1.185977 Aug 08 13:35:45.933245 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 32/51] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:44 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:45.941246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-823287705", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f99375f-7b41-4df8-ae3e-5e6aad84dbaf"}], "security_groups": [{"name": "tempest-securitygroup--1025691681"}], "key_name": "tempest-keypair-1180825876", "user_data": "}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:46.430514 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:35:46.431575 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:35:46.432162 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:35:46.432904 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:35:46.440086 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:35:46.507304 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:46.508161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:46.508952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:46.510395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:46.539413 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:46.540434 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:46.676913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:35:46.706129 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for user fce6a7d7dbc94adeb0b03bae34e335a0 and project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:35:46.769241 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:35:46.787145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:35:46.836241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] validate_networks() for [('7f99375f-7b41-4df8-ae3e-5e6aad84dbaf', None, None, None, None, None)] {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:35:46.955168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8acad865-18f2-48a7-a633-ac6865764c5c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.856687 Aug 08 13:35:46.955857 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 20/52] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:35:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 5861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:35:46.965301 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2180511d-685f-4383-ba22-89fdcaaea1df tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:46.969273 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2180511d-685f-4383-ba22-89fdcaaea1df tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:46.997551 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2180511d-685f-4383-ba22-89fdcaaea1df tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:47.000506 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2180511d-685f-4383-ba22-89fdcaaea1df tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:47.003676 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2180511d-685f-4383-ba22-89fdcaaea1df tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:47.004730 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2180511d-685f-4383-ba22-89fdcaaea1df tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:47.005219 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2180511d-685f-4383-ba22-89fdcaaea1df tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:47.005708 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2180511d-685f-4383-ba22-89fdcaaea1df tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:47.762438 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2180511d-685f-4383-ba22-89fdcaaea1df tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:47.773121 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2180511d-685f-4383-ba22-89fdcaaea1df tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1273 microversion: 2.1 time: 0.813962 Aug 08 13:35:47.788312 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 21/53] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:46 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1273 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:48.918129 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-142103d5-84d4-4ee1-a09e-defd685c8e77 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Action: 'create', calling method: .version_select at 0x7f7d24e1edc0>, body: {"keypair": {"name": "tempest-keypair-996692206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEksqvkKx3Gx2k/7DZWQ3itSTbeA/49Ofwxg6vSaGLPDU3Y5PAJB11xiqGWQBJSTtXlbE/rucguw0lcbTaYdL3cFIR9xZhj5JZz5KilM6YrvODQ2DtSZmZZyti7oILtz2Q=="}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:48.970914 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-142103d5-84d4-4ee1-a09e-defd685c8e77 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Getting quotas for project 0831512491044565b17fb6dd11a57b5f. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:35:48.981113 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-142103d5-84d4-4ee1-a09e-defd685c8e77 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Getting quotas for user c29ce05ebc6e4672bb9557f751a48557 and project 0831512491044565b17fb6dd11a57b5f. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:35:49.033831 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:35:49.034544 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:35:49.034898 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:35:49.035351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:35:49.035770 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:35:49.041846 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:49.043938 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-142103d5-84d4-4ee1-a09e-defd685c8e77 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.253228 Aug 08 13:35:49.044946 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 22/54] 10.222.0.33 () {62 vars in 1200 bytes} [Mon Aug 8 13:35:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1256 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 13:35:49.058871 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=21 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:49.064721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:49.065245 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:49.065890 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:49.066910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:49.069558 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:49.070265 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:49.081146 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5bde0b41-cf31-4144-beba-6dedcd663de0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:49.082633 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-5bde0b41-cf31-4144-beba-6dedcd663de0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:49.100041 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bde0b41-cf31-4144-beba-6dedcd663de0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:49.101554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bde0b41-cf31-4144-beba-6dedcd663de0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:49.102508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bde0b41-cf31-4144-beba-6dedcd663de0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:49.103989 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bde0b41-cf31-4144-beba-6dedcd663de0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:49.104985 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bde0b41-cf31-4144-beba-6dedcd663de0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:49.106903 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bde0b41-cf31-4144-beba-6dedcd663de0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:49.119728 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Getting quotas for project 643240773a5840d3af2622469d696beb. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:35:49.125662 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Getting quotas for user 651659e941044454985b2f866b791b07 and project 643240773a5840d3af2622469d696beb. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:35:49.140870 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:35:49.143892 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:35:49.151055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=39 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:49.223248 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-dfe0788e-7386-499a-b9d5-a51cbf9ae8a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.285383 Aug 08 13:35:49.224671 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 33/55] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:35:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 3291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:35:49.231337 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0e3cc42a-e039-44f1-9f3a-48ecda9edeb9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:49.232214 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0e3cc42a-e039-44f1-9f3a-48ecda9edeb9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:49.255799 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e3cc42a-e039-44f1-9f3a-48ecda9edeb9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:49.256875 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e3cc42a-e039-44f1-9f3a-48ecda9edeb9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:49.257775 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e3cc42a-e039-44f1-9f3a-48ecda9edeb9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:49.259299 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e3cc42a-e039-44f1-9f3a-48ecda9edeb9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:49.260467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e3cc42a-e039-44f1-9f3a-48ecda9edeb9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:49.261715 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e3cc42a-e039-44f1-9f3a-48ecda9edeb9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:49.652116 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0e3cc42a-e039-44f1-9f3a-48ecda9edeb9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:49.675941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0e3cc42a-e039-44f1-9f3a-48ecda9edeb9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1237 microversion: 2.1 time: 0.449461 Aug 08 13:35:49.678502 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 34/56] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:49 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1237 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:49.689633 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ee706c32-4c22-49a4-992c-57a877516883 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:49.691495 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ee706c32-4c22-49a4-992c-57a877516883 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:49.704784 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee706c32-4c22-49a4-992c-57a877516883 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:49.706159 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee706c32-4c22-49a4-992c-57a877516883 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:49.707237 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee706c32-4c22-49a4-992c-57a877516883 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:49.709358 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee706c32-4c22-49a4-992c-57a877516883 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:49.711602 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee706c32-4c22-49a4-992c-57a877516883 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:49.712844 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee706c32-4c22-49a4-992c-57a877516883 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:50.018780 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ee706c32-4c22-49a4-992c-57a877516883 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:50.087392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ee706c32-4c22-49a4-992c-57a877516883 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1279 microversion: 2.1 time: 0.402580 Aug 08 13:35:50.099140 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 35/57] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:49 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1279 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:50.103628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-5bde0b41-cf31-4144-beba-6dedcd663de0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:50.115959 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-5bde0b41-cf31-4144-beba-6dedcd663de0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 1.048441 Aug 08 13:35:50.117619 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 23/58] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:49 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:50.141111 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8ff92c7a-93bf-4548-bd10-7b999c3c09c3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:50.147601 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8ff92c7a-93bf-4548-bd10-7b999c3c09c3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:50.459674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8ff92c7a-93bf-4548-bd10-7b999c3c09c3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:50.480262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8ff92c7a-93bf-4548-bd10-7b999c3c09c3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1237 microversion: 2.1 time: 0.377067 Aug 08 13:35:50.493658 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 36/59] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:50 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1237 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:50.712331 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-559a99d0-5542-49e5-b38c-5030ecda3640 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:50.713231 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-559a99d0-5542-49e5-b38c-5030ecda3640 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:50.722927 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-559a99d0-5542-49e5-b38c-5030ecda3640 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:50.727939 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-559a99d0-5542-49e5-b38c-5030ecda3640 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:50.728678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-559a99d0-5542-49e5-b38c-5030ecda3640 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:50.729598 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-559a99d0-5542-49e5-b38c-5030ecda3640 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:50.730274 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-559a99d0-5542-49e5-b38c-5030ecda3640 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:50.733961 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-559a99d0-5542-49e5-b38c-5030ecda3640 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:50.922135 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-559a99d0-5542-49e5-b38c-5030ecda3640 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:50.933788 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-559a99d0-5542-49e5-b38c-5030ecda3640 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1293 microversion: 2.1 time: 0.225504 Aug 08 13:35:50.936270 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 24/60] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:50 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1293 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:51.138238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-18876f58-43ff-4835-a171-2c3bb27e943a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:51.139706 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-18876f58-43ff-4835-a171-2c3bb27e943a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:51.150849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-18876f58-43ff-4835-a171-2c3bb27e943a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:51.151703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-18876f58-43ff-4835-a171-2c3bb27e943a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:51.152436 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-18876f58-43ff-4835-a171-2c3bb27e943a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:51.164497 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-18876f58-43ff-4835-a171-2c3bb27e943a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:51.165116 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-18876f58-43ff-4835-a171-2c3bb27e943a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:51.165672 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-18876f58-43ff-4835-a171-2c3bb27e943a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:51.175980 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1cdbb326-e6e2-4156-aa86-26a2af09c6e5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:51.182063 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1cdbb326-e6e2-4156-aa86-26a2af09c6e5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:51.239519 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1cdbb326-e6e2-4156-aa86-26a2af09c6e5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:51.245259 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1cdbb326-e6e2-4156-aa86-26a2af09c6e5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:51.249109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1cdbb326-e6e2-4156-aa86-26a2af09c6e5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:51.252249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1cdbb326-e6e2-4156-aa86-26a2af09c6e5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:51.253459 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1cdbb326-e6e2-4156-aa86-26a2af09c6e5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:51.259247 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1cdbb326-e6e2-4156-aa86-26a2af09c6e5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:51.841361 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-18876f58-43ff-4835-a171-2c3bb27e943a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:51.866620 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-18876f58-43ff-4835-a171-2c3bb27e943a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.732337 Aug 08 13:35:51.867683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 37/61] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:51 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:51.885957 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-30252b78-6c69-4783-abfb-341fd577c598 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:51.887133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-30252b78-6c69-4783-abfb-341fd577c598 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:51.926682 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30252b78-6c69-4783-abfb-341fd577c598 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:51.927875 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30252b78-6c69-4783-abfb-341fd577c598 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:51.930276 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30252b78-6c69-4783-abfb-341fd577c598 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:51.937013 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30252b78-6c69-4783-abfb-341fd577c598 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:51.938225 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30252b78-6c69-4783-abfb-341fd577c598 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:51.954206 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30252b78-6c69-4783-abfb-341fd577c598 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:52.185938 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-30252b78-6c69-4783-abfb-341fd577c598 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:52.203927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-30252b78-6c69-4783-abfb-341fd577c598 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1241 microversion: 2.1 time: 0.334784 Aug 08 13:35:52.204698 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 38/62] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:51 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1241 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:52.215572 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-565087d5-d30f-4975-bbe8-e2c735516041 req-ebebb956-9d9b-482f-934a-d122c0806270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff259851-1c4f-411c-b555-ded6a785a91d", "tag": "9faa6157-ecf9-4af1-8d81-b0aeaca39586"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:52.236820 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-1cdbb326-e6e2-4156-aa86-26a2af09c6e5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:52.252357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1cdbb326-e6e2-4156-aa86-26a2af09c6e5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 1.112880 Aug 08 13:35:52.269615 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 25/63] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:51 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:52.287212 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-18ccf61a-f42d-42cd-bdc9-8bec987da516 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:52.288359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-18ccf61a-f42d-42cd-bdc9-8bec987da516 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:52.301687 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18ccf61a-f42d-42cd-bdc9-8bec987da516 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:52.302575 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18ccf61a-f42d-42cd-bdc9-8bec987da516 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:52.310253 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18ccf61a-f42d-42cd-bdc9-8bec987da516 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:52.312088 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18ccf61a-f42d-42cd-bdc9-8bec987da516 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:52.315244 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18ccf61a-f42d-42cd-bdc9-8bec987da516 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:52.315780 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-565087d5-d30f-4975-bbe8-e2c735516041 req-ebebb956-9d9b-482f-934a-d122c0806270 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:52.317047 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18ccf61a-f42d-42cd-bdc9-8bec987da516 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:52.318483 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-565087d5-d30f-4975-bbe8-e2c735516041 req-ebebb956-9d9b-482f-934a-d122c0806270 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:52.324260 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-565087d5-d30f-4975-bbe8-e2c735516041 req-ebebb956-9d9b-482f-934a-d122c0806270 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:52.448169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-565087d5-d30f-4975-bbe8-e2c735516041 req-ebebb956-9d9b-482f-934a-d122c0806270 service nova] Creating event network-changed:9faa6157-ecf9-4af1-8d81-b0aeaca39586 for instance ff259851-1c4f-411c-b555-ded6a785a91d on hv-cinder-85199 Aug 08 13:35:52.451486 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-565087d5-d30f-4975-bbe8-e2c735516041 req-ebebb956-9d9b-482f-934a-d122c0806270 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 13:35:52.463785 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-565087d5-d30f-4975-bbe8-e2c735516041 req-ebebb956-9d9b-482f-934a-d122c0806270 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 13:35:52.465926 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c271eabb-2383-43d6-828e-01682e8d4b80 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:52.471201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c271eabb-2383-43d6-828e-01682e8d4b80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:52.472168 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c271eabb-2383-43d6-828e-01682e8d4b80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:52.473617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c271eabb-2383-43d6-828e-01682e8d4b80 None None] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:52.481461 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c271eabb-2383-43d6-828e-01682e8d4b80 None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:52.482746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c271eabb-2383-43d6-828e-01682e8d4b80 None None] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:52.499028 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-18ccf61a-f42d-42cd-bdc9-8bec987da516 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:52.514958 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.compute.rpcapi [None req-c271eabb-2383-43d6-828e-01682e8d4b80 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 13:35:52.521933 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c271eabb-2383-43d6-828e-01682e8d4b80 None None] Releasing lock "compute-rpcapi-router" {{(pid=124407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 13:35:52.532152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-18ccf61a-f42d-42cd-bdc9-8bec987da516 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1293 microversion: 2.1 time: 0.260261 Aug 08 13:35:52.541069 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 26/64] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:52 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1293 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:52.603439 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c271eabb-2383-43d6-828e-01682e8d4b80 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.396814 Aug 08 13:35:52.604519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 39/65] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:52.907443 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-90aac980-01b8-4b7b-95c0-79d76120c48f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:52.912416 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-90aac980-01b8-4b7b-95c0-79d76120c48f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:52.935242 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90aac980-01b8-4b7b-95c0-79d76120c48f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:52.938570 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90aac980-01b8-4b7b-95c0-79d76120c48f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:52.939801 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90aac980-01b8-4b7b-95c0-79d76120c48f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:52.945268 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90aac980-01b8-4b7b-95c0-79d76120c48f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:52.953596 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90aac980-01b8-4b7b-95c0-79d76120c48f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:52.955153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90aac980-01b8-4b7b-95c0-79d76120c48f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:53.250398 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-20ff9979-1c44-4360-9510-f072371f984e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:53.250398 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-20ff9979-1c44-4360-9510-f072371f984e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:53.293580 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20ff9979-1c44-4360-9510-f072371f984e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:53.307045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20ff9979-1c44-4360-9510-f072371f984e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:53.308324 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20ff9979-1c44-4360-9510-f072371f984e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:53.311459 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20ff9979-1c44-4360-9510-f072371f984e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:53.312561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20ff9979-1c44-4360-9510-f072371f984e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:53.316041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20ff9979-1c44-4360-9510-f072371f984e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:53.536092 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-20ff9979-1c44-4360-9510-f072371f984e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:53.552239 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-90aac980-01b8-4b7b-95c0-79d76120c48f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:53.566456 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-20ff9979-1c44-4360-9510-f072371f984e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1233 microversion: 2.1 time: 0.322591 Aug 08 13:35:53.574492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 40/66] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:53 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1233 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:53.589771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-90aac980-01b8-4b7b-95c0-79d76120c48f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.683674 Aug 08 13:35:53.601317 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-64264297-cc51-492e-9f14-006dab6535f7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:53.609819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-64264297-cc51-492e-9f14-006dab6535f7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:53.621794 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 27/67] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:52 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:53.629504 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-64264297-cc51-492e-9f14-006dab6535f7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:53.630290 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-64264297-cc51-492e-9f14-006dab6535f7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:53.631010 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-64264297-cc51-492e-9f14-006dab6535f7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:53.652552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-64264297-cc51-492e-9f14-006dab6535f7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:53.654124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-64264297-cc51-492e-9f14-006dab6535f7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:53.655169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-64264297-cc51-492e-9f14-006dab6535f7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:53.673010 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e92f0884-0fd4-4e3c-aea1-d14e43cde9a1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:53.681201 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e92f0884-0fd4-4e3c-aea1-d14e43cde9a1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:53.706199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e92f0884-0fd4-4e3c-aea1-d14e43cde9a1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:53.709922 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e92f0884-0fd4-4e3c-aea1-d14e43cde9a1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:53.711126 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e92f0884-0fd4-4e3c-aea1-d14e43cde9a1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:53.716273 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e92f0884-0fd4-4e3c-aea1-d14e43cde9a1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:53.718624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e92f0884-0fd4-4e3c-aea1-d14e43cde9a1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:53.721339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e92f0884-0fd4-4e3c-aea1-d14e43cde9a1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:54.002276 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e92f0884-0fd4-4e3c-aea1-d14e43cde9a1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:54.021300 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e92f0884-0fd4-4e3c-aea1-d14e43cde9a1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1301 microversion: 2.1 time: 0.397576 Aug 08 13:35:54.038559 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 28/68] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:53 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1301 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:54.174749 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-64264297-cc51-492e-9f14-006dab6535f7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:54.185015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-64264297-cc51-492e-9f14-006dab6535f7 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.608740 Aug 08 13:35:54.188296 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 41/69] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:53 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:54.604768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6d8896ba-aa62-4b5b-a592-d7a01a7831f2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:54.605666 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6d8896ba-aa62-4b5b-a592-d7a01a7831f2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:54.616921 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d8896ba-aa62-4b5b-a592-d7a01a7831f2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:54.617591 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d8896ba-aa62-4b5b-a592-d7a01a7831f2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:54.622904 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d8896ba-aa62-4b5b-a592-d7a01a7831f2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:54.624320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d8896ba-aa62-4b5b-a592-d7a01a7831f2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:54.630597 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-95b94f24-e2ea-4f75-ba5d-2f09f806b964 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:54.632054 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-95b94f24-e2ea-4f75-ba5d-2f09f806b964 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:54.638040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d8896ba-aa62-4b5b-a592-d7a01a7831f2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:54.639591 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d8896ba-aa62-4b5b-a592-d7a01a7831f2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:54.647097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-95b94f24-e2ea-4f75-ba5d-2f09f806b964 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:54.656205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-95b94f24-e2ea-4f75-ba5d-2f09f806b964 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:54.656984 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-95b94f24-e2ea-4f75-ba5d-2f09f806b964 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:54.658073 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-95b94f24-e2ea-4f75-ba5d-2f09f806b964 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:54.658786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-95b94f24-e2ea-4f75-ba5d-2f09f806b964 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:54.661647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-95b94f24-e2ea-4f75-ba5d-2f09f806b964 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:54.878082 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6d8896ba-aa62-4b5b-a592-d7a01a7831f2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:54.915744 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6d8896ba-aa62-4b5b-a592-d7a01a7831f2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1297 microversion: 2.1 time: 0.313169 Aug 08 13:35:54.918939 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 29/70] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:54 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1297 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:35:55.051207 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fe307159-4ea3-4654-bd70-852051bbde75 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:55.052161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fe307159-4ea3-4654-bd70-852051bbde75 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:55.078079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe307159-4ea3-4654-bd70-852051bbde75 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:55.079002 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe307159-4ea3-4654-bd70-852051bbde75 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:55.079908 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe307159-4ea3-4654-bd70-852051bbde75 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:55.081423 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe307159-4ea3-4654-bd70-852051bbde75 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:55.082507 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe307159-4ea3-4654-bd70-852051bbde75 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:55.083498 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe307159-4ea3-4654-bd70-852051bbde75 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:55.358663 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fe307159-4ea3-4654-bd70-852051bbde75 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:55.374918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fe307159-4ea3-4654-bd70-852051bbde75 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1299 microversion: 2.1 time: 0.331704 Aug 08 13:35:55.392159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 30/71] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:55 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1299 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:55.412454 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-da6b57dc-9d48-4d18-bdc9-652e710e2358 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:55.414181 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-da6b57dc-9d48-4d18-bdc9-652e710e2358 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:55.438288 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da6b57dc-9d48-4d18-bdc9-652e710e2358 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:55.439825 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da6b57dc-9d48-4d18-bdc9-652e710e2358 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:55.442153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da6b57dc-9d48-4d18-bdc9-652e710e2358 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:55.446073 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da6b57dc-9d48-4d18-bdc9-652e710e2358 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:55.448244 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da6b57dc-9d48-4d18-bdc9-652e710e2358 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:55.450388 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da6b57dc-9d48-4d18-bdc9-652e710e2358 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:55.676215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-95b94f24-e2ea-4f75-ba5d-2f09f806b964 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:55.713946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-95b94f24-e2ea-4f75-ba5d-2f09f806b964 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 1.087776 Aug 08 13:35:55.734223 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 42/72] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:54 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:55.945363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-687d2213-2ecf-4d51-a4a5-14b960d04a16 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:55.946411 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-687d2213-2ecf-4d51-a4a5-14b960d04a16 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:55.963583 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-687d2213-2ecf-4d51-a4a5-14b960d04a16 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:55.965591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-687d2213-2ecf-4d51-a4a5-14b960d04a16 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:55.966588 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-687d2213-2ecf-4d51-a4a5-14b960d04a16 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:55.968008 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-687d2213-2ecf-4d51-a4a5-14b960d04a16 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:55.970851 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-687d2213-2ecf-4d51-a4a5-14b960d04a16 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:55.971884 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-687d2213-2ecf-4d51-a4a5-14b960d04a16 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:56.212642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-687d2213-2ecf-4d51-a4a5-14b960d04a16 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:56.234696 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-687d2213-2ecf-4d51-a4a5-14b960d04a16 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1295 microversion: 2.1 time: 0.297848 Aug 08 13:35:56.240630 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 43/73] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:55 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1295 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:56.336105 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-da6b57dc-9d48-4d18-bdc9-652e710e2358 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:56.359040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-da6b57dc-9d48-4d18-bdc9-652e710e2358 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.962756 Aug 08 13:35:56.363674 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 31/74] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:55 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:56.443757 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ce8e32d2-97a3-457a-8a99-ae2344dab1b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:56.457117 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ce8e32d2-97a3-457a-8a99-ae2344dab1b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:56.496527 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce8e32d2-97a3-457a-8a99-ae2344dab1b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:56.501770 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce8e32d2-97a3-457a-8a99-ae2344dab1b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:56.502735 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce8e32d2-97a3-457a-8a99-ae2344dab1b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:56.506252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce8e32d2-97a3-457a-8a99-ae2344dab1b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:56.513918 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce8e32d2-97a3-457a-8a99-ae2344dab1b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:56.515057 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce8e32d2-97a3-457a-8a99-ae2344dab1b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:56.758358 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=4 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:56.769281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fafa41b9-2f90-4f5c-a9c5-469d9f779d43 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:56.786226 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fafa41b9-2f90-4f5c-a9c5-469d9f779d43 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:56.815943 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fafa41b9-2f90-4f5c-a9c5-469d9f779d43 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:56.827270 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fafa41b9-2f90-4f5c-a9c5-469d9f779d43 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:56.828417 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fafa41b9-2f90-4f5c-a9c5-469d9f779d43 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:56.831255 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fafa41b9-2f90-4f5c-a9c5-469d9f779d43 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:56.834980 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fafa41b9-2f90-4f5c-a9c5-469d9f779d43 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:56.843031 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ce8e32d2-97a3-457a-8a99-ae2344dab1b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:56.850845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fafa41b9-2f90-4f5c-a9c5-469d9f779d43 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:56.877583 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ce8e32d2-97a3-457a-8a99-ae2344dab1b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1299 microversion: 2.1 time: 0.446824 Aug 08 13:35:56.885668 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 44/75] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:56 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1299 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:56.896496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-5381435a-8bbb-4b4e-ad3d-fb3021e90ac4 req-093e305f-2de8-4468-b6c4-ead192e5dcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4ef4518-23e7-4182-8a95-59a287fe5eff", "tag": "ff67f5bc-bd23-4f24-bcc8-fb3ea1bcb89b"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:56.916968 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-5381435a-8bbb-4b4e-ad3d-fb3021e90ac4 req-093e305f-2de8-4468-b6c4-ead192e5dcb4 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:56.918138 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-5381435a-8bbb-4b4e-ad3d-fb3021e90ac4 req-093e305f-2de8-4468-b6c4-ead192e5dcb4 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:56.920171 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-5381435a-8bbb-4b4e-ad3d-fb3021e90ac4 req-093e305f-2de8-4468-b6c4-ead192e5dcb4 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:56.973917 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-5381435a-8bbb-4b4e-ad3d-fb3021e90ac4 req-093e305f-2de8-4468-b6c4-ead192e5dcb4 service nova] Creating event network-changed:ff67f5bc-bd23-4f24-bcc8-fb3ea1bcb89b for instance a4ef4518-23e7-4182-8a95-59a287fe5eff on hv-cinder-85199 Aug 08 13:35:56.993883 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-5381435a-8bbb-4b4e-ad3d-fb3021e90ac4 req-093e305f-2de8-4468-b6c4-ead192e5dcb4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104537 Aug 08 13:35:56.996499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 45/76] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:57.275811 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-34ee897d-6773-4aba-bb2c-6987b4570647 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:57.277752 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-34ee897d-6773-4aba-bb2c-6987b4570647 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:57.292394 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34ee897d-6773-4aba-bb2c-6987b4570647 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:57.293643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34ee897d-6773-4aba-bb2c-6987b4570647 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:57.294687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34ee897d-6773-4aba-bb2c-6987b4570647 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:57.296495 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34ee897d-6773-4aba-bb2c-6987b4570647 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:57.297563 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34ee897d-6773-4aba-bb2c-6987b4570647 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:57.298642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34ee897d-6773-4aba-bb2c-6987b4570647 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:57.337109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fafa41b9-2f90-4f5c-a9c5-469d9f779d43 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:57.368180 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fafa41b9-2f90-4f5c-a9c5-469d9f779d43 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.611852 Aug 08 13:35:57.386101 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 32/77] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:56 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:57.416324 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4255db6b-9393-4b1f-9650-b549c9ae0fa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:57.418511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4255db6b-9393-4b1f-9650-b549c9ae0fa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:57.447546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4255db6b-9393-4b1f-9650-b549c9ae0fa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:57.453794 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4255db6b-9393-4b1f-9650-b549c9ae0fa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:57.457352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4255db6b-9393-4b1f-9650-b549c9ae0fa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:57.463795 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4255db6b-9393-4b1f-9650-b549c9ae0fa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:57.465462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4255db6b-9393-4b1f-9650-b549c9ae0fa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:57.471306 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4255db6b-9393-4b1f-9650-b549c9ae0fa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:57.623360 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-34ee897d-6773-4aba-bb2c-6987b4570647 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:57.653826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-34ee897d-6773-4aba-bb2c-6987b4570647 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1295 microversion: 2.1 time: 0.394192 Aug 08 13:35:57.659182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 46/78] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:57 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1295 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:57.911382 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-af292052-73aa-415f-a47c-0cb7079ce418 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:57.912547 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-af292052-73aa-415f-a47c-0cb7079ce418 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:57.950499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-af292052-73aa-415f-a47c-0cb7079ce418 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:57.951436 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-af292052-73aa-415f-a47c-0cb7079ce418 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:57.952476 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-af292052-73aa-415f-a47c-0cb7079ce418 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:57.954009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-af292052-73aa-415f-a47c-0cb7079ce418 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:57.955242 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-af292052-73aa-415f-a47c-0cb7079ce418 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:57.957360 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-af292052-73aa-415f-a47c-0cb7079ce418 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:58.330480 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4255db6b-9393-4b1f-9650-b549c9ae0fa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:58.363361 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4255db6b-9393-4b1f-9650-b549c9ae0fa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.971497 Aug 08 13:35:58.364930 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 33/79] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:57 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:58.414168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dd9c3e30-0724-4134-bfdc-a3094e6587ab tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:58.416476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-dd9c3e30-0724-4134-bfdc-a3094e6587ab tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:58.443274 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd9c3e30-0724-4134-bfdc-a3094e6587ab tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:58.445399 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd9c3e30-0724-4134-bfdc-a3094e6587ab tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:58.445966 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-af292052-73aa-415f-a47c-0cb7079ce418 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:58.446151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd9c3e30-0724-4134-bfdc-a3094e6587ab tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:58.450124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=83 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:58.450385 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd9c3e30-0724-4134-bfdc-a3094e6587ab tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:58.451252 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd9c3e30-0724-4134-bfdc-a3094e6587ab tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:58.452017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd9c3e30-0724-4134-bfdc-a3094e6587ab tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:58.465796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-af292052-73aa-415f-a47c-0cb7079ce418 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1299 microversion: 2.1 time: 0.562933 Aug 08 13:35:58.478205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 47/80] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:57 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1299 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:58.678608 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9a2e9a73-d38e-4a3c-926c-fd235ff9ea1f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:58.679728 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9a2e9a73-d38e-4a3c-926c-fd235ff9ea1f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:58.701301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a2e9a73-d38e-4a3c-926c-fd235ff9ea1f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:58.705064 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a2e9a73-d38e-4a3c-926c-fd235ff9ea1f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:58.705821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a2e9a73-d38e-4a3c-926c-fd235ff9ea1f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:58.707829 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a2e9a73-d38e-4a3c-926c-fd235ff9ea1f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:58.713134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a2e9a73-d38e-4a3c-926c-fd235ff9ea1f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:58.715888 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a2e9a73-d38e-4a3c-926c-fd235ff9ea1f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:58.996578 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=10 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:35:59.164262 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-dd9c3e30-0724-4134-bfdc-a3094e6587ab tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:59.187633 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-dd9c3e30-0724-4134-bfdc-a3094e6587ab tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.775773 Aug 08 13:35:59.213591 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 34/81] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:58 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:35:59.219338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-943942408", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5d048dd-1a56-432c-af83-8892c932e019"}], "security_groups": [{"name": "tempest-securitygroup--411657021"}], "key_name": "tempest-keypair-996692206", "user_data": "}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:59.222967 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9a2e9a73-d38e-4a3c-926c-fd235ff9ea1f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:35:59.241239 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9a2e9a73-d38e-4a3c-926c-fd235ff9ea1f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.567324 Aug 08 13:35:59.244012 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 48/82] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:58 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:35:59.405610 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] validate_networks() for [('c5d048dd-1a56-432c-af83-8892c932e019', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:35:59.513715 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-6f91ba74-0e18-42b4-b631-fe8ad1be3eb9 req-2aa7b8e0-47cf-497b-b9df-6374fd76c253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488cdad7-8bac-4f8a-b412-851f6f2486a3", "name": "network-vif-plugged", "status": "completed", "tag": "9eb1a549-51fa-449c-98c1-c9211fba91ec"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:35:59.526088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-6f91ba74-0e18-42b4-b631-fe8ad1be3eb9 req-2aa7b8e0-47cf-497b-b9df-6374fd76c253 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:59.526752 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-6f91ba74-0e18-42b4-b631-fe8ad1be3eb9 req-2aa7b8e0-47cf-497b-b9df-6374fd76c253 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:59.527700 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-6f91ba74-0e18-42b4-b631-fe8ad1be3eb9 req-2aa7b8e0-47cf-497b-b9df-6374fd76c253 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:59.547158 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-6f91ba74-0e18-42b4-b631-fe8ad1be3eb9 req-2aa7b8e0-47cf-497b-b9df-6374fd76c253 service nova] Creating event network-vif-plugged:9eb1a549-51fa-449c-98c1-c9211fba91ec for instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 on hv-cinder-85199 Aug 08 13:35:59.555037 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-6f91ba74-0e18-42b4-b631-fe8ad1be3eb9 req-2aa7b8e0-47cf-497b-b9df-6374fd76c253 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308927 Aug 08 13:35:59.556871 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 49/83] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:35:59.564365 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-48adbea8-11a8-4cbd-8dcd-f45b292339bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:35:59.565744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-48adbea8-11a8-4cbd-8dcd-f45b292339bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:35:59.574713 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-48adbea8-11a8-4cbd-8dcd-f45b292339bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:59.575715 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-48adbea8-11a8-4cbd-8dcd-f45b292339bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:59.576270 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-48adbea8-11a8-4cbd-8dcd-f45b292339bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:59.577892 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-48adbea8-11a8-4cbd-8dcd-f45b292339bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:35:59.578499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-48adbea8-11a8-4cbd-8dcd-f45b292339bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:35:59.579211 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-48adbea8-11a8-4cbd-8dcd-f45b292339bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:35:59.998008 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-48adbea8-11a8-4cbd-8dcd-f45b292339bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:00.010489 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-48adbea8-11a8-4cbd-8dcd-f45b292339bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.451706 Aug 08 13:36:00.011241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 50/84] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:35:59 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:00.016763 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d089b5e2-c89e-4f5a-9f47-0c43560517b5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:00.018113 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d089b5e2-c89e-4f5a-9f47-0c43560517b5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:00.026388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d089b5e2-c89e-4f5a-9f47-0c43560517b5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:00.026995 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d089b5e2-c89e-4f5a-9f47-0c43560517b5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:00.027751 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d089b5e2-c89e-4f5a-9f47-0c43560517b5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:00.028601 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d089b5e2-c89e-4f5a-9f47-0c43560517b5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:00.029143 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d089b5e2-c89e-4f5a-9f47-0c43560517b5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:00.029649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d089b5e2-c89e-4f5a-9f47-0c43560517b5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:00.416954 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d089b5e2-c89e-4f5a-9f47-0c43560517b5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:00.430508 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d089b5e2-c89e-4f5a-9f47-0c43560517b5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.417707 Aug 08 13:36:00.432971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 51/85] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:00 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:00.449038 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1bb01277-2b5c-478c-a10a-62019a528069 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:00.450496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1bb01277-2b5c-478c-a10a-62019a528069 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:00.479029 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=7 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:00.484888 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bb01277-2b5c-478c-a10a-62019a528069 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:00.486116 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bb01277-2b5c-478c-a10a-62019a528069 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:00.486992 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bb01277-2b5c-478c-a10a-62019a528069 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:00.488616 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bb01277-2b5c-478c-a10a-62019a528069 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:00.491859 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bb01277-2b5c-478c-a10a-62019a528069 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:00.492778 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bb01277-2b5c-478c-a10a-62019a528069 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:00.524053 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:36:00.525095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:36:00.527928 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:36:00.528841 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:36:00.529589 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:36:00.551100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:00.552823 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:00.556372 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:00.559710 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:00.564209 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:00.564772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:00.592059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Getting quotas for project 0831512491044565b17fb6dd11a57b5f. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:36:00.597154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Getting quotas for user c29ce05ebc6e4672bb9557f751a48557 and project 0831512491044565b17fb6dd11a57b5f. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:36:00.620829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:36:00.623542 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:36:00.678246 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-64b5c971-139d-4f33-a377-a98589a9e378 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.463317 Aug 08 13:36:00.678906 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 35/86] 10.222.0.33 () {62 vars in 1188 bytes} [Mon Aug 8 13:35:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 13:36:00.684047 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-81e9c0b0-d134-40c9-ab0f-f83481cd42ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:00.684896 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-81e9c0b0-d134-40c9-ab0f-f83481cd42ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:00.692925 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81e9c0b0-d134-40c9-ab0f-f83481cd42ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:00.693741 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81e9c0b0-d134-40c9-ab0f-f83481cd42ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:00.694328 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81e9c0b0-d134-40c9-ab0f-f83481cd42ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:00.695251 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81e9c0b0-d134-40c9-ab0f-f83481cd42ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:00.696038 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81e9c0b0-d134-40c9-ab0f-f83481cd42ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:00.696627 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81e9c0b0-d134-40c9-ab0f-f83481cd42ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:00.733603 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1bb01277-2b5c-478c-a10a-62019a528069 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:00.749843 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1bb01277-2b5c-478c-a10a-62019a528069 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.314309 Aug 08 13:36:00.752117 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 52/87] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:00 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:00.764985 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2c95bbc6-5196-404c-b94c-701df7ba4141 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:00.768254 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2c95bbc6-5196-404c-b94c-701df7ba4141 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:00.854284 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2c95bbc6-5196-404c-b94c-701df7ba4141 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:00.864254 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2c95bbc6-5196-404c-b94c-701df7ba4141 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:00.866216 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2c95bbc6-5196-404c-b94c-701df7ba4141 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:00.873545 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2c95bbc6-5196-404c-b94c-701df7ba4141 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1280 microversion: 2.20 time: 0.118673 Aug 08 13:36:00.889315 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 53/88] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:00 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1280 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:00.976655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-81e9c0b0-d134-40c9-ab0f-f83481cd42ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:00.986053 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-81e9c0b0-d134-40c9-ab0f-f83481cd42ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.305838 Aug 08 13:36:01.000126 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 36/89] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:00 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:01.038429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5fc1b826-afe5-4d5a-915a-79d9f2f33aa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:01.040013 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5fc1b826-afe5-4d5a-915a-79d9f2f33aa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:01.051884 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5fc1b826-afe5-4d5a-915a-79d9f2f33aa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:01.052757 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5fc1b826-afe5-4d5a-915a-79d9f2f33aa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:01.053546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5fc1b826-afe5-4d5a-915a-79d9f2f33aa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:01.060104 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5fc1b826-afe5-4d5a-915a-79d9f2f33aa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:01.061525 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5fc1b826-afe5-4d5a-915a-79d9f2f33aa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:01.062932 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5fc1b826-afe5-4d5a-915a-79d9f2f33aa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:01.247975 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5fc1b826-afe5-4d5a-915a-79d9f2f33aa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:01.259566 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5fc1b826-afe5-4d5a-915a-79d9f2f33aa5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.229454 Aug 08 13:36:01.261040 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 54/90] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:01 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:01.482247 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-406452f5-0f45-41c0-8d6e-d10143488378 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:01.483303 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-406452f5-0f45-41c0-8d6e-d10143488378 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:01.497594 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-406452f5-0f45-41c0-8d6e-d10143488378 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:01.498980 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-406452f5-0f45-41c0-8d6e-d10143488378 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:01.499832 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-406452f5-0f45-41c0-8d6e-d10143488378 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:01.501761 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-406452f5-0f45-41c0-8d6e-d10143488378 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:01.503070 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-406452f5-0f45-41c0-8d6e-d10143488378 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:01.504095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-406452f5-0f45-41c0-8d6e-d10143488378 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:01.772545 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a676457f-dd22-451d-adda-437297f90232 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:01.774326 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a676457f-dd22-451d-adda-437297f90232 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:01.781056 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a676457f-dd22-451d-adda-437297f90232 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:01.781798 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a676457f-dd22-451d-adda-437297f90232 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:01.782434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a676457f-dd22-451d-adda-437297f90232 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:01.783331 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a676457f-dd22-451d-adda-437297f90232 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:01.784008 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a676457f-dd22-451d-adda-437297f90232 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:01.784639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a676457f-dd22-451d-adda-437297f90232 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:02.099249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-406452f5-0f45-41c0-8d6e-d10143488378 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:02.112040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-406452f5-0f45-41c0-8d6e-d10143488378 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.634140 Aug 08 13:36:02.112681 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 37/91] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:01 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:02.118198 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:02.118893 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:02.135984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:02.137050 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:02.137699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:02.152037 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:02.152683 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:02.153154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:02.225345 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a676457f-dd22-451d-adda-437297f90232 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:02.235973 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a676457f-dd22-451d-adda-437297f90232 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.467282 Aug 08 13:36:02.236575 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 55/92] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:01 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:02.249149 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c9bf0453-3fee-4ce0-93e6-54816a0abaaf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:02.259213 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c9bf0453-3fee-4ce0-93e6-54816a0abaaf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:02.284195 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c9bf0453-3fee-4ce0-93e6-54816a0abaaf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:02.285160 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c9bf0453-3fee-4ce0-93e6-54816a0abaaf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:02.285820 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c9bf0453-3fee-4ce0-93e6-54816a0abaaf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:02.290508 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c9bf0453-3fee-4ce0-93e6-54816a0abaaf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:02.291216 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c9bf0453-3fee-4ce0-93e6-54816a0abaaf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:02.303523 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c9bf0453-3fee-4ce0-93e6-54816a0abaaf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:02.458284 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:02.471512 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:02.473192 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:02.474460 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ae77def4-34ef-433c-b3db-2f50da545258 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1284 microversion: 2.20 time: 0.360752 Aug 08 13:36:02.475126 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 38/93] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:02 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1284 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:02.481233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-ccac176f-bd07-4468-bafe-b4ad5d69f457 req-b511ee7a-91f0-4e6b-bd99-9c3857f26a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11502875-0366-4e45-876a-43cbc50f7261", "tag": "01423313-09fc-4ac2-a4ed-f147bfe4ee5c"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:02.510902 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=8 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:02.520736 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-ccac176f-bd07-4468-bafe-b4ad5d69f457 req-b511ee7a-91f0-4e6b-bd99-9c3857f26a3d service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:02.526728 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-ccac176f-bd07-4468-bafe-b4ad5d69f457 req-b511ee7a-91f0-4e6b-bd99-9c3857f26a3d service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:02.529274 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-ccac176f-bd07-4468-bafe-b4ad5d69f457 req-b511ee7a-91f0-4e6b-bd99-9c3857f26a3d service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:02.587037 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-ccac176f-bd07-4468-bafe-b4ad5d69f457 req-b511ee7a-91f0-4e6b-bd99-9c3857f26a3d service nova] Creating event network-changed:01423313-09fc-4ac2-a4ed-f147bfe4ee5c for instance 11502875-0366-4e45-876a-43cbc50f7261 on hv-cinder-85199 Aug 08 13:36:02.608280 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-ccac176f-bd07-4468-bafe-b4ad5d69f457 req-b511ee7a-91f0-4e6b-bd99-9c3857f26a3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131077 Aug 08 13:36:02.617765 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 39/94] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:02.638826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-07cf0231-43a5-43ef-9252-e04f5a60a03e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:02.641044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-07cf0231-43a5-43ef-9252-e04f5a60a03e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:02.657087 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07cf0231-43a5-43ef-9252-e04f5a60a03e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:02.658888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07cf0231-43a5-43ef-9252-e04f5a60a03e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:02.660342 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07cf0231-43a5-43ef-9252-e04f5a60a03e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:02.662159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07cf0231-43a5-43ef-9252-e04f5a60a03e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:02.663595 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07cf0231-43a5-43ef-9252-e04f5a60a03e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:02.664796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07cf0231-43a5-43ef-9252-e04f5a60a03e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:02.988046 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c9bf0453-3fee-4ce0-93e6-54816a0abaaf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:03.002126 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c9bf0453-3fee-4ce0-93e6-54816a0abaaf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.757164 Aug 08 13:36:03.002734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 56/95] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:02 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:03.143357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-07cf0231-43a5-43ef-9252-e04f5a60a03e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:03.151521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c4b70006-9864-4992-ba75-bfc8971d7bae tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:03.154725 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-07cf0231-43a5-43ef-9252-e04f5a60a03e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.534735 Aug 08 13:36:03.155398 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c4b70006-9864-4992-ba75-bfc8971d7bae tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:03.155597 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 40/96] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:02 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:03.181156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4b70006-9864-4992-ba75-bfc8971d7bae tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:03.182027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4b70006-9864-4992-ba75-bfc8971d7bae tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:03.182806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4b70006-9864-4992-ba75-bfc8971d7bae tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:03.184174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4b70006-9864-4992-ba75-bfc8971d7bae tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:03.185004 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4b70006-9864-4992-ba75-bfc8971d7bae tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:03.185995 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4b70006-9864-4992-ba75-bfc8971d7bae tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:03.279424 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-55c25323-146a-4752-9f93-d9117f7dfc1f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:03.280071 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-55c25323-146a-4752-9f93-d9117f7dfc1f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:03.292438 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-55c25323-146a-4752-9f93-d9117f7dfc1f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:03.292958 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-55c25323-146a-4752-9f93-d9117f7dfc1f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:03.293428 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-55c25323-146a-4752-9f93-d9117f7dfc1f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:03.294180 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-55c25323-146a-4752-9f93-d9117f7dfc1f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:03.294646 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-55c25323-146a-4752-9f93-d9117f7dfc1f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:03.295159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-55c25323-146a-4752-9f93-d9117f7dfc1f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:03.298543 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:03.720071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c4b70006-9864-4992-ba75-bfc8971d7bae tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:03.722042 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-55c25323-146a-4752-9f93-d9117f7dfc1f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:03.732293 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-55c25323-146a-4752-9f93-d9117f7dfc1f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.456829 Aug 08 13:36:03.733760 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 41/97] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:03 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:03.739444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:03.740400 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:03.748138 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c4b70006-9864-4992-ba75-bfc8971d7bae tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.604225 Aug 08 13:36:03.748475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:03.749138 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:03.749766 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:03.750601 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:03.751324 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:03.752046 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:03.765809 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 57/98] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:03 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:03.829143 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:03.841806 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:03.845048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:03.847244 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-439f64b1-f26e-433a-9b9d-9abc7c989b07 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1284 microversion: 2.20 time: 0.111597 Aug 08 13:36:03.848296 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 42/99] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:03 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:04.030310 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e6d517fc-7c77-42a4-b310-a409a393bcf5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:04.030935 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e6d517fc-7c77-42a4-b310-a409a393bcf5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:04.038162 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e6d517fc-7c77-42a4-b310-a409a393bcf5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:04.038694 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e6d517fc-7c77-42a4-b310-a409a393bcf5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:04.040057 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e6d517fc-7c77-42a4-b310-a409a393bcf5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:04.041091 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e6d517fc-7c77-42a4-b310-a409a393bcf5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:04.041768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e6d517fc-7c77-42a4-b310-a409a393bcf5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:04.042384 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e6d517fc-7c77-42a4-b310-a409a393bcf5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:04.061058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-32fad6ca-f575-4f78-8ac5-42abf174ce8a req-074a7528-5fb1-4672-8357-8d33371faf5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3195b877-5ac0-4c2f-94b0-6afebf0a0ad9", "tag": "2bfebcac-007b-41e0-a9b7-10b445528bcf"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:04.081851 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-32fad6ca-f575-4f78-8ac5-42abf174ce8a req-074a7528-5fb1-4672-8357-8d33371faf5e service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:04.083943 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-32fad6ca-f575-4f78-8ac5-42abf174ce8a req-074a7528-5fb1-4672-8357-8d33371faf5e service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:04.085306 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-32fad6ca-f575-4f78-8ac5-42abf174ce8a req-074a7528-5fb1-4672-8357-8d33371faf5e service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:04.112175 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-32fad6ca-f575-4f78-8ac5-42abf174ce8a req-074a7528-5fb1-4672-8357-8d33371faf5e service nova] Creating event network-changed:2bfebcac-007b-41e0-a9b7-10b445528bcf for instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 on hv-cinder-85199 Aug 08 13:36:04.123689 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-32fad6ca-f575-4f78-8ac5-42abf174ce8a req-074a7528-5fb1-4672-8357-8d33371faf5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352821 Aug 08 13:36:04.126619 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 58/100] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:04.185255 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1c056abb-564f-4d53-939e-7870363a3b45 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:04.193294 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1c056abb-564f-4d53-939e-7870363a3b45 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:04.209197 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c056abb-564f-4d53-939e-7870363a3b45 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:04.210974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c056abb-564f-4d53-939e-7870363a3b45 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:04.212247 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c056abb-564f-4d53-939e-7870363a3b45 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:04.213848 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c056abb-564f-4d53-939e-7870363a3b45 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:04.215067 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c056abb-564f-4d53-939e-7870363a3b45 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:04.216325 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c056abb-564f-4d53-939e-7870363a3b45 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:04.295978 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e6d517fc-7c77-42a4-b310-a409a393bcf5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:04.347159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e6d517fc-7c77-42a4-b310-a409a393bcf5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.326552 Aug 08 13:36:04.365679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 43/101] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:04 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:04.506879 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1c056abb-564f-4d53-939e-7870363a3b45 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:04.521280 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1c056abb-564f-4d53-939e-7870363a3b45 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.347403 Aug 08 13:36:04.535995 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 59/102] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:04 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:04.760499 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fb821f7b-ab63-4c19-b6a0-a12aa2cec4ea tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:04.761669 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fb821f7b-ab63-4c19-b6a0-a12aa2cec4ea tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:04.774099 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb821f7b-ab63-4c19-b6a0-a12aa2cec4ea tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:04.775678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb821f7b-ab63-4c19-b6a0-a12aa2cec4ea tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:04.776106 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb821f7b-ab63-4c19-b6a0-a12aa2cec4ea tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:04.777716 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb821f7b-ab63-4c19-b6a0-a12aa2cec4ea tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:04.778560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb821f7b-ab63-4c19-b6a0-a12aa2cec4ea tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:04.779359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb821f7b-ab63-4c19-b6a0-a12aa2cec4ea tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:04.805772 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-505c7ce8-08ef-4a9c-be91-abac544d7a98 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:04.807388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-505c7ce8-08ef-4a9c-be91-abac544d7a98 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:04.837217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-505c7ce8-08ef-4a9c-be91-abac544d7a98 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:04.839959 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-505c7ce8-08ef-4a9c-be91-abac544d7a98 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:04.846764 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-505c7ce8-08ef-4a9c-be91-abac544d7a98 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:04.848760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-505c7ce8-08ef-4a9c-be91-abac544d7a98 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:04.849853 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-505c7ce8-08ef-4a9c-be91-abac544d7a98 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:04.850987 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-505c7ce8-08ef-4a9c-be91-abac544d7a98 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:05.148221 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fb821f7b-ab63-4c19-b6a0-a12aa2cec4ea tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:05.164343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fb821f7b-ab63-4c19-b6a0-a12aa2cec4ea tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.410228 Aug 08 13:36:05.166009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 44/103] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:04 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:05.179649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:05.181809 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:05.196407 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:05.198458 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:05.199750 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:05.201462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:05.202555 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:05.203449 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:05.220774 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-505c7ce8-08ef-4a9c-be91-abac544d7a98 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:05.236615 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-505c7ce8-08ef-4a9c-be91-abac544d7a98 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.443099 Aug 08 13:36:05.238413 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 60/104] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:04 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:05.330401 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:05.343878 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:05.347198 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:05.348796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2238f02d-7f0b-423b-ae09-b229a268480c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1284 microversion: 2.20 time: 0.181080 Aug 08 13:36:05.350250 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 45/105] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:05 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:05.386754 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ec22a988-a78d-4336-a290-e7e91cfe5349 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:05.388396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ec22a988-a78d-4336-a290-e7e91cfe5349 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:05.416439 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec22a988-a78d-4336-a290-e7e91cfe5349 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:05.419522 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec22a988-a78d-4336-a290-e7e91cfe5349 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:05.420391 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec22a988-a78d-4336-a290-e7e91cfe5349 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:05.422005 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec22a988-a78d-4336-a290-e7e91cfe5349 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:05.423331 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec22a988-a78d-4336-a290-e7e91cfe5349 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:05.424415 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec22a988-a78d-4336-a290-e7e91cfe5349 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:05.552395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-befd0d7d-a1d3-47d4-9c58-a2878c3cc6f2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:05.553421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-befd0d7d-a1d3-47d4-9c58-a2878c3cc6f2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:05.563992 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-befd0d7d-a1d3-47d4-9c58-a2878c3cc6f2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:05.565115 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-befd0d7d-a1d3-47d4-9c58-a2878c3cc6f2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:05.566336 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-befd0d7d-a1d3-47d4-9c58-a2878c3cc6f2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:05.567786 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-befd0d7d-a1d3-47d4-9c58-a2878c3cc6f2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:05.568854 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-befd0d7d-a1d3-47d4-9c58-a2878c3cc6f2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:05.569564 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-befd0d7d-a1d3-47d4-9c58-a2878c3cc6f2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:05.657649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ec22a988-a78d-4336-a290-e7e91cfe5349 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:05.674795 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ec22a988-a78d-4336-a290-e7e91cfe5349 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.295391 Aug 08 13:36:05.692124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 61/106] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:05 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:05.812390 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-befd0d7d-a1d3-47d4-9c58-a2878c3cc6f2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:05.825838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-befd0d7d-a1d3-47d4-9c58-a2878c3cc6f2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.279561 Aug 08 13:36:05.826924 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 46/107] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:05 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:06.209305 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f50182fd-8c8f-4f60-98e9-7eabe43ad600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:06.210360 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f50182fd-8c8f-4f60-98e9-7eabe43ad600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:06.219914 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f50182fd-8c8f-4f60-98e9-7eabe43ad600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:06.220576 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f50182fd-8c8f-4f60-98e9-7eabe43ad600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:06.221166 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f50182fd-8c8f-4f60-98e9-7eabe43ad600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:06.222365 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f50182fd-8c8f-4f60-98e9-7eabe43ad600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:06.223011 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f50182fd-8c8f-4f60-98e9-7eabe43ad600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:06.223802 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f50182fd-8c8f-4f60-98e9-7eabe43ad600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:06.277918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c336e8c6-1dea-44ab-a839-16f7af7e50b7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:06.278882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c336e8c6-1dea-44ab-a839-16f7af7e50b7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:06.298009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c336e8c6-1dea-44ab-a839-16f7af7e50b7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:06.298838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c336e8c6-1dea-44ab-a839-16f7af7e50b7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:06.299636 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c336e8c6-1dea-44ab-a839-16f7af7e50b7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:06.300945 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c336e8c6-1dea-44ab-a839-16f7af7e50b7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:06.301733 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c336e8c6-1dea-44ab-a839-16f7af7e50b7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:06.302489 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c336e8c6-1dea-44ab-a839-16f7af7e50b7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:06.538018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f50182fd-8c8f-4f60-98e9-7eabe43ad600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:06.552790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f50182fd-8c8f-4f60-98e9-7eabe43ad600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.347507 Aug 08 13:36:06.554246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 62/108] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:06 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:06.564162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:06.565375 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:06.577428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:06.578319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:06.579190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:06.580265 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:06.580829 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:06.581405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:06.584008 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c336e8c6-1dea-44ab-a839-16f7af7e50b7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:06.598725 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c336e8c6-1dea-44ab-a839-16f7af7e50b7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.325652 Aug 08 13:36:06.607221 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 47/109] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:06 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:06.683520 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:06.694231 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:06.696897 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:06.698556 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f363ff41-cb01-403b-b347-fd4a91567a3f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1284 microversion: 2.20 time: 0.142953 Aug 08 13:36:06.699553 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 63/110] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:06 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:06.714243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8a5c362b-9d11-40e9-ae64-ee404f8bb80b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:06.715201 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8a5c362b-9d11-40e9-ae64-ee404f8bb80b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:06.720480 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:06.726543 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8a5c362b-9d11-40e9-ae64-ee404f8bb80b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:06.727245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8a5c362b-9d11-40e9-ae64-ee404f8bb80b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:06.727807 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8a5c362b-9d11-40e9-ae64-ee404f8bb80b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:06.728580 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8a5c362b-9d11-40e9-ae64-ee404f8bb80b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:06.729077 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8a5c362b-9d11-40e9-ae64-ee404f8bb80b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:06.729543 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8a5c362b-9d11-40e9-ae64-ee404f8bb80b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:06.850005 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-11b08c22-5c59-47b0-a175-36f33e2d529c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:06.850931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-11b08c22-5c59-47b0-a175-36f33e2d529c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:06.862301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-11b08c22-5c59-47b0-a175-36f33e2d529c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:06.863151 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-11b08c22-5c59-47b0-a175-36f33e2d529c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:06.864650 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-11b08c22-5c59-47b0-a175-36f33e2d529c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:06.866554 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-11b08c22-5c59-47b0-a175-36f33e2d529c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:06.867711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-11b08c22-5c59-47b0-a175-36f33e2d529c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:06.868532 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-11b08c22-5c59-47b0-a175-36f33e2d529c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:07.021750 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8a5c362b-9d11-40e9-ae64-ee404f8bb80b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:07.038448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8a5c362b-9d11-40e9-ae64-ee404f8bb80b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.330614 Aug 08 13:36:07.051966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 48/111] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:06 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:07.108186 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-11b08c22-5c59-47b0-a175-36f33e2d529c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:07.119629 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-11b08c22-5c59-47b0-a175-36f33e2d529c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.274740 Aug 08 13:36:07.120499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 64/112] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:06 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:07.591646 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-15570073-75a3-4e68-b9b3-77e19fa44605 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:07.594004 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-15570073-75a3-4e68-b9b3-77e19fa44605 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:07.604365 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-15570073-75a3-4e68-b9b3-77e19fa44605 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:07.604963 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-15570073-75a3-4e68-b9b3-77e19fa44605 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:07.605823 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-15570073-75a3-4e68-b9b3-77e19fa44605 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:07.606889 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-15570073-75a3-4e68-b9b3-77e19fa44605 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:07.607761 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-15570073-75a3-4e68-b9b3-77e19fa44605 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:07.608342 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-15570073-75a3-4e68-b9b3-77e19fa44605 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:07.643008 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-932ae416-a164-49fb-ae19-7a4ebb6f529d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:07.643886 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-932ae416-a164-49fb-ae19-7a4ebb6f529d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:07.650525 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-932ae416-a164-49fb-ae19-7a4ebb6f529d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:07.651121 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-932ae416-a164-49fb-ae19-7a4ebb6f529d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:07.651640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-932ae416-a164-49fb-ae19-7a4ebb6f529d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:07.652613 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-932ae416-a164-49fb-ae19-7a4ebb6f529d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:07.653165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-932ae416-a164-49fb-ae19-7a4ebb6f529d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:07.653658 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-932ae416-a164-49fb-ae19-7a4ebb6f529d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:07.965557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-15570073-75a3-4e68-b9b3-77e19fa44605 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:07.981421 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-932ae416-a164-49fb-ae19-7a4ebb6f529d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:07.987947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-15570073-75a3-4e68-b9b3-77e19fa44605 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.403445 Aug 08 13:36:07.990215 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 49/113] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:07 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:07.992447 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-932ae416-a164-49fb-ae19-7a4ebb6f529d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.353623 Aug 08 13:36:07.993986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 65/114] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:07 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:08.015918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:08.021030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:08.044005 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:08.046023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:08.048104 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:08.051984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:08.052879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:08.055404 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:08.074220 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5b136d95-7234-4908-bf41-46f09a259b67 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:08.075816 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5b136d95-7234-4908-bf41-46f09a259b67 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:08.109751 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b136d95-7234-4908-bf41-46f09a259b67 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:08.110446 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b136d95-7234-4908-bf41-46f09a259b67 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:08.112353 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b136d95-7234-4908-bf41-46f09a259b67 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:08.117232 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b136d95-7234-4908-bf41-46f09a259b67 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:08.118589 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b136d95-7234-4908-bf41-46f09a259b67 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:08.124008 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b136d95-7234-4908-bf41-46f09a259b67 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:08.393512 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:08.441284 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:08.444874 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:08.461654 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4f54a67b-b95d-4cca-9c26-7c9927b3e179 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1284 microversion: 2.20 time: 0.454921 Aug 08 13:36:08.479778 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 50/115] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:07 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1284 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:08.516067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dc380ea9-cd50-44a3-86cd-38f29ae750fb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:08.517415 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-dc380ea9-cd50-44a3-86cd-38f29ae750fb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:08.563836 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc380ea9-cd50-44a3-86cd-38f29ae750fb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:08.565037 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc380ea9-cd50-44a3-86cd-38f29ae750fb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:08.566030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc380ea9-cd50-44a3-86cd-38f29ae750fb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:08.567715 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc380ea9-cd50-44a3-86cd-38f29ae750fb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:08.569293 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc380ea9-cd50-44a3-86cd-38f29ae750fb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:08.570398 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc380ea9-cd50-44a3-86cd-38f29ae750fb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:08.770000 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5b136d95-7234-4908-bf41-46f09a259b67 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:08.772511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=100 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:08.784240 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5b136d95-7234-4908-bf41-46f09a259b67 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.715483 Aug 08 13:36:08.785747 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 66/116] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:08 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:08.852193 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-dc380ea9-cd50-44a3-86cd-38f29ae750fb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:08.862591 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-dc380ea9-cd50-44a3-86cd-38f29ae750fb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.381098 Aug 08 13:36:08.863380 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 51/117] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:08 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:09.026288 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f22c063a-fe8e-454f-abd6-429d6a03d519 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:09.029434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-59216fb6-9b96-4185-8a3e-546b124f0301 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:09.030285 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-59216fb6-9b96-4185-8a3e-546b124f0301 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:09.033932 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f22c063a-fe8e-454f-abd6-429d6a03d519 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:09.050911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f22c063a-fe8e-454f-abd6-429d6a03d519 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:09.053820 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59216fb6-9b96-4185-8a3e-546b124f0301 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:09.055339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f22c063a-fe8e-454f-abd6-429d6a03d519 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:09.055984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f22c063a-fe8e-454f-abd6-429d6a03d519 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:09.057001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f22c063a-fe8e-454f-abd6-429d6a03d519 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:09.057760 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f22c063a-fe8e-454f-abd6-429d6a03d519 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:09.058875 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59216fb6-9b96-4185-8a3e-546b124f0301 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:09.059467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59216fb6-9b96-4185-8a3e-546b124f0301 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:09.060579 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59216fb6-9b96-4185-8a3e-546b124f0301 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:09.061336 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59216fb6-9b96-4185-8a3e-546b124f0301 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:09.061971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59216fb6-9b96-4185-8a3e-546b124f0301 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:09.067228 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f22c063a-fe8e-454f-abd6-429d6a03d519 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:09.337622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-f22c063a-fe8e-454f-abd6-429d6a03d519 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:09.350353 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f22c063a-fe8e-454f-abd6-429d6a03d519 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.328449 Aug 08 13:36:09.350763 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 52/118] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:09 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:09.362031 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-59216fb6-9b96-4185-8a3e-546b124f0301 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:09.397630 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-59216fb6-9b96-4185-8a3e-546b124f0301 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.381071 Aug 08 13:36:09.398674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 67/119] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:09 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:09.513566 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:09.514912 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:09.526764 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:09.528094 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:09.529264 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:09.530220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:09.530803 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:09.531359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:09.617798 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:09.629392 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:09.631319 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:09.633138 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-18c68de4-72ed-47e6-a965-21f0a0858ab4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1332 microversion: 2.20 time: 0.126096 Aug 08 13:36:09.633763 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 53/120] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:09 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:36:09.836192 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ada5f26f-8d0b-457d-95ab-065c6c62d047 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:09.839272 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ada5f26f-8d0b-457d-95ab-065c6c62d047 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:09.851660 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ada5f26f-8d0b-457d-95ab-065c6c62d047 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:09.852704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ada5f26f-8d0b-457d-95ab-065c6c62d047 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:09.853790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ada5f26f-8d0b-457d-95ab-065c6c62d047 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:09.855413 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ada5f26f-8d0b-457d-95ab-065c6c62d047 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:09.856230 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ada5f26f-8d0b-457d-95ab-065c6c62d047 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:09.857161 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ada5f26f-8d0b-457d-95ab-065c6c62d047 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:09.911484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-92b48cea-bd7b-4404-ab04-66a5657d70b4 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:09.912553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-92b48cea-bd7b-4404-ab04-66a5657d70b4 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:09.926512 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-92b48cea-bd7b-4404-ab04-66a5657d70b4 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:09.927132 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-92b48cea-bd7b-4404-ab04-66a5657d70b4 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:09.927651 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-92b48cea-bd7b-4404-ab04-66a5657d70b4 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:09.928573 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-92b48cea-bd7b-4404-ab04-66a5657d70b4 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:09.929132 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-92b48cea-bd7b-4404-ab04-66a5657d70b4 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:09.930925 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-92b48cea-bd7b-4404-ab04-66a5657d70b4 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:10.185674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ada5f26f-8d0b-457d-95ab-065c6c62d047 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:10.203332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ada5f26f-8d0b-457d-95ab-065c6c62d047 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.374562 Aug 08 13:36:10.204153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-92b48cea-bd7b-4404-ab04-66a5657d70b4 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:10.218506 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-92b48cea-bd7b-4404-ab04-66a5657d70b4 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.324551 Aug 08 13:36:10.220088 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 54/122] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:09 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:10.220337 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 68/122] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:09 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:10.394768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ddc6c092-4e4c-4735-98b9-0a58dd95f184 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:10.395440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ddc6c092-4e4c-4735-98b9-0a58dd95f184 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:10.402629 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc6c092-4e4c-4735-98b9-0a58dd95f184 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:10.403254 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc6c092-4e4c-4735-98b9-0a58dd95f184 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:10.403757 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc6c092-4e4c-4735-98b9-0a58dd95f184 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:10.404546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc6c092-4e4c-4735-98b9-0a58dd95f184 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:10.405064 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc6c092-4e4c-4735-98b9-0a58dd95f184 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:10.405557 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc6c092-4e4c-4735-98b9-0a58dd95f184 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:10.425708 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-13f1cf7a-bea2-4746-a136-696a36c6b7ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:10.426319 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-13f1cf7a-bea2-4746-a136-696a36c6b7ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:10.440469 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13f1cf7a-bea2-4746-a136-696a36c6b7ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:10.440961 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13f1cf7a-bea2-4746-a136-696a36c6b7ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:10.441662 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13f1cf7a-bea2-4746-a136-696a36c6b7ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:10.442556 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13f1cf7a-bea2-4746-a136-696a36c6b7ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:10.443214 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13f1cf7a-bea2-4746-a136-696a36c6b7ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:10.443783 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13f1cf7a-bea2-4746-a136-696a36c6b7ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:10.580707 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:10.607191 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:10.762777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-13f1cf7a-bea2-4746-a136-696a36c6b7ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:10.768878 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ddc6c092-4e4c-4735-98b9-0a58dd95f184 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:10.788937 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-13f1cf7a-bea2-4746-a136-696a36c6b7ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.371203 Aug 08 13:36:10.789986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 55/123] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:10 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:10.798597 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ddc6c092-4e4c-4735-98b9-0a58dd95f184 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.415383 Aug 08 13:36:10.801112 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 69/124] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:10 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:10.814021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:10.818737 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:10.838327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:10.839454 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:10.840251 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:10.841478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:10.842330 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:10.843034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:10.956027 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:10.982418 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:10.985540 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:10.987475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4ef6fbdf-504d-4c75-8dea-dc1cee1c7ee1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1332 microversion: 2.20 time: 0.193343 Aug 08 13:36:10.987677 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 56/125] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:10 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1332 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:11.169809 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-36c9d220-809d-4bbc-8695-3bc44456fddb req-eae28547-6f07-44d6-bdd4-f2469390d639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff259851-1c4f-411c-b555-ded6a785a91d", "name": "network-vif-plugged", "status": "completed", "tag": "9faa6157-ecf9-4af1-8d81-b0aeaca39586"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:11.180681 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:11.206215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-36c9d220-809d-4bbc-8695-3bc44456fddb req-eae28547-6f07-44d6-bdd4-f2469390d639 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:11.209562 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-36c9d220-809d-4bbc-8695-3bc44456fddb req-eae28547-6f07-44d6-bdd4-f2469390d639 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:11.210294 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-36c9d220-809d-4bbc-8695-3bc44456fddb req-eae28547-6f07-44d6-bdd4-f2469390d639 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:11.230973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-47279036-047b-4035-871b-5bae0a2d1155 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:11.231708 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-47279036-047b-4035-871b-5bae0a2d1155 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:11.246478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47279036-047b-4035-871b-5bae0a2d1155 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:11.247326 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47279036-047b-4035-871b-5bae0a2d1155 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:11.250257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47279036-047b-4035-871b-5bae0a2d1155 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:11.251740 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47279036-047b-4035-871b-5bae0a2d1155 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:11.253551 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47279036-047b-4035-871b-5bae0a2d1155 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:11.254183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47279036-047b-4035-871b-5bae0a2d1155 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:11.271273 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-36c9d220-809d-4bbc-8695-3bc44456fddb req-eae28547-6f07-44d6-bdd4-f2469390d639 service nova] Creating event network-vif-plugged:9faa6157-ecf9-4af1-8d81-b0aeaca39586 for instance ff259851-1c4f-411c-b555-ded6a785a91d on hv-cinder-85199 Aug 08 13:36:11.292361 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-36c9d220-809d-4bbc-8695-3bc44456fddb req-eae28547-6f07-44d6-bdd4-f2469390d639 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130853 Aug 08 13:36:11.296615 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 70/126] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:11.319503 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f5073ba4-02bc-4ba0-9f1d-23854bc1c5f5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:11.321981 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f5073ba4-02bc-4ba0-9f1d-23854bc1c5f5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:11.335590 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5073ba4-02bc-4ba0-9f1d-23854bc1c5f5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:11.336471 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5073ba4-02bc-4ba0-9f1d-23854bc1c5f5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:11.337287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5073ba4-02bc-4ba0-9f1d-23854bc1c5f5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:11.338813 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5073ba4-02bc-4ba0-9f1d-23854bc1c5f5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:11.339902 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5073ba4-02bc-4ba0-9f1d-23854bc1c5f5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:11.341972 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5073ba4-02bc-4ba0-9f1d-23854bc1c5f5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:11.560242 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-47279036-047b-4035-871b-5bae0a2d1155 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:11.562967 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:11.571938 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-47279036-047b-4035-871b-5bae0a2d1155 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.346117 Aug 08 13:36:11.573253 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 57/127] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:11 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:11.610377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f5073ba4-02bc-4ba0-9f1d-23854bc1c5f5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:11.631033 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f5073ba4-02bc-4ba0-9f1d-23854bc1c5f5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.328265 Aug 08 13:36:11.632623 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 71/128] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:11 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:11.834551 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f5eb0b9d-9ec5-4521-9286-f613a9bbb22f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:11.835508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f5eb0b9d-9ec5-4521-9286-f613a9bbb22f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:11.837359 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0657003d-bb16-40b6-bd59-ccd2e3fb0c91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:11.838489 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0657003d-bb16-40b6-bd59-ccd2e3fb0c91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:11.844292 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f5eb0b9d-9ec5-4521-9286-f613a9bbb22f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:11.844954 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f5eb0b9d-9ec5-4521-9286-f613a9bbb22f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:11.845386 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f5eb0b9d-9ec5-4521-9286-f613a9bbb22f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:11.846158 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f5eb0b9d-9ec5-4521-9286-f613a9bbb22f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:11.846571 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f5eb0b9d-9ec5-4521-9286-f613a9bbb22f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:11.846994 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f5eb0b9d-9ec5-4521-9286-f613a9bbb22f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:11.848154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0657003d-bb16-40b6-bd59-ccd2e3fb0c91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:11.848718 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0657003d-bb16-40b6-bd59-ccd2e3fb0c91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:11.849252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0657003d-bb16-40b6-bd59-ccd2e3fb0c91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:11.850164 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0657003d-bb16-40b6-bd59-ccd2e3fb0c91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:11.850747 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0657003d-bb16-40b6-bd59-ccd2e3fb0c91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:11.854624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0657003d-bb16-40b6-bd59-ccd2e3fb0c91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:12.110036 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-f5eb0b9d-9ec5-4521-9286-f613a9bbb22f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:12.126025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f5eb0b9d-9ec5-4521-9286-f613a9bbb22f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.301997 Aug 08 13:36:12.132622 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0657003d-bb16-40b6-bd59-ccd2e3fb0c91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:12.139616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 58/129] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:11 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:12.147871 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0657003d-bb16-40b6-bd59-ccd2e3fb0c91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.317229 Aug 08 13:36:12.149449 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 72/130] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:11 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:12.153104 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:12.154037 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:12.162504 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:12.163068 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:12.163603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:12.164545 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:12.165221 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:12.165775 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:12.246762 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:12.262466 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:12.265783 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:12.267959 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-034c4a9f-439e-4e4c-8233-4379a2b7c730 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1332 microversion: 2.20 time: 0.126372 Aug 08 13:36:12.268981 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 59/131] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:12 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:12.607755 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-dad5b2ff-8416-4224-b22e-64b20eabaaad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:12.608645 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-dad5b2ff-8416-4224-b22e-64b20eabaaad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:12.617180 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dad5b2ff-8416-4224-b22e-64b20eabaaad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:12.617828 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dad5b2ff-8416-4224-b22e-64b20eabaaad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:12.618429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dad5b2ff-8416-4224-b22e-64b20eabaaad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:12.619326 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dad5b2ff-8416-4224-b22e-64b20eabaaad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:12.620002 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dad5b2ff-8416-4224-b22e-64b20eabaaad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:12.620618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dad5b2ff-8416-4224-b22e-64b20eabaaad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:12.661205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9c630a47-17ca-45e2-9367-9bb583e7baa6 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:12.663024 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9c630a47-17ca-45e2-9367-9bb583e7baa6 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:12.673933 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c630a47-17ca-45e2-9367-9bb583e7baa6 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:12.674522 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c630a47-17ca-45e2-9367-9bb583e7baa6 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:12.674959 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c630a47-17ca-45e2-9367-9bb583e7baa6 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:12.675755 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c630a47-17ca-45e2-9367-9bb583e7baa6 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:12.676433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c630a47-17ca-45e2-9367-9bb583e7baa6 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:12.676864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c630a47-17ca-45e2-9367-9bb583e7baa6 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:12.872741 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dad5b2ff-8416-4224-b22e-64b20eabaaad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:12.887291 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-dad5b2ff-8416-4224-b22e-64b20eabaaad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.284274 Aug 08 13:36:12.888874 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 73/132] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:12 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:12.913808 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9c630a47-17ca-45e2-9367-9bb583e7baa6 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:12.922347 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9c630a47-17ca-45e2-9367-9bb583e7baa6 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.268281 Aug 08 13:36:12.923038 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 60/133] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:12 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:13.160818 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6ede48d0-06b6-4fd4-80b4-a43c5ee15be2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:13.162048 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6ede48d0-06b6-4fd4-80b4-a43c5ee15be2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:13.173957 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-04eb3942-d161-48a3-9a42-96b189a7165f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:13.184429 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-04eb3942-d161-48a3-9a42-96b189a7165f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:13.202906 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-04eb3942-d161-48a3-9a42-96b189a7165f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:13.203541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-04eb3942-d161-48a3-9a42-96b189a7165f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:13.204129 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-04eb3942-d161-48a3-9a42-96b189a7165f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:13.205040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-04eb3942-d161-48a3-9a42-96b189a7165f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:13.212199 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ede48d0-06b6-4fd4-80b4-a43c5ee15be2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:13.212946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ede48d0-06b6-4fd4-80b4-a43c5ee15be2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:13.213497 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ede48d0-06b6-4fd4-80b4-a43c5ee15be2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:13.215339 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ede48d0-06b6-4fd4-80b4-a43c5ee15be2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:13.215339 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ede48d0-06b6-4fd4-80b4-a43c5ee15be2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:13.215542 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ede48d0-06b6-4fd4-80b4-a43c5ee15be2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:13.219518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-04eb3942-d161-48a3-9a42-96b189a7165f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:13.220493 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-04eb3942-d161-48a3-9a42-96b189a7165f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:13.545548 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6ede48d0-06b6-4fd4-80b4-a43c5ee15be2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:13.562291 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6ede48d0-06b6-4fd4-80b4-a43c5ee15be2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.407108 Aug 08 13:36:13.563455 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 74/134] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:13 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:13.572643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:13.574203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:13.577452 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:13.584643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:13.585061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:13.585494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:13.586218 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:13.586675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:13.587173 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:13.592858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-04eb3942-d161-48a3-9a42-96b189a7165f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:13.605992 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-04eb3942-d161-48a3-9a42-96b189a7165f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.438939 Aug 08 13:36:13.607067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 61/135] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:13 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:13.653923 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:13.663555 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:13.665120 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:13.666288 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b285935f-f688-462b-8d64-2c6a5325ad88 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1332 microversion: 2.20 time: 0.101116 Aug 08 13:36:13.667005 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 75/136] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:13 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:13.918477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-493fdb3d-e7aa-42e4-a566-ed6b3315f8f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:13.919114 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-493fdb3d-e7aa-42e4-a566-ed6b3315f8f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:13.925936 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-493fdb3d-e7aa-42e4-a566-ed6b3315f8f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:13.926422 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-493fdb3d-e7aa-42e4-a566-ed6b3315f8f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:13.926850 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-493fdb3d-e7aa-42e4-a566-ed6b3315f8f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:13.927604 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-493fdb3d-e7aa-42e4-a566-ed6b3315f8f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:13.928093 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-493fdb3d-e7aa-42e4-a566-ed6b3315f8f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:13.928500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-493fdb3d-e7aa-42e4-a566-ed6b3315f8f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:13.958152 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0b104ea6-2294-49a2-836e-65e3184bc0af tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:13.958944 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0b104ea6-2294-49a2-836e-65e3184bc0af tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:13.966420 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0b104ea6-2294-49a2-836e-65e3184bc0af tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:13.966915 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0b104ea6-2294-49a2-836e-65e3184bc0af tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:13.967380 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0b104ea6-2294-49a2-836e-65e3184bc0af tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:13.968084 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0b104ea6-2294-49a2-836e-65e3184bc0af tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:13.968558 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0b104ea6-2294-49a2-836e-65e3184bc0af tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:13.968949 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0b104ea6-2294-49a2-836e-65e3184bc0af tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:14.336478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-493fdb3d-e7aa-42e4-a566-ed6b3315f8f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:14.348724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-493fdb3d-e7aa-42e4-a566-ed6b3315f8f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.433998 Aug 08 13:36:14.349872 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 62/137] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:13 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:14.393131 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0b104ea6-2294-49a2-836e-65e3184bc0af tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:14.405551 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0b104ea6-2294-49a2-836e-65e3184bc0af tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.451341 Aug 08 13:36:14.406519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 76/138] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:13 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:14.585734 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fc2223c3-7095-4418-beef-db3a40aa9c6f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:14.586720 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fc2223c3-7095-4418-beef-db3a40aa9c6f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:14.597134 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fc2223c3-7095-4418-beef-db3a40aa9c6f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:14.598005 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fc2223c3-7095-4418-beef-db3a40aa9c6f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:14.598786 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fc2223c3-7095-4418-beef-db3a40aa9c6f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:14.600323 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fc2223c3-7095-4418-beef-db3a40aa9c6f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:14.601447 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fc2223c3-7095-4418-beef-db3a40aa9c6f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:14.602301 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fc2223c3-7095-4418-beef-db3a40aa9c6f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:14.633208 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-519691e1-e656-43cc-9c08-cdd4e7ca09fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:14.639527 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-519691e1-e656-43cc-9c08-cdd4e7ca09fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:14.655030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-519691e1-e656-43cc-9c08-cdd4e7ca09fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:14.657458 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-519691e1-e656-43cc-9c08-cdd4e7ca09fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:14.658497 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-519691e1-e656-43cc-9c08-cdd4e7ca09fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:14.660499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-519691e1-e656-43cc-9c08-cdd4e7ca09fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:14.661467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-519691e1-e656-43cc-9c08-cdd4e7ca09fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:14.662104 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-519691e1-e656-43cc-9c08-cdd4e7ca09fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:15.153952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fc2223c3-7095-4418-beef-db3a40aa9c6f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:15.178205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fc2223c3-7095-4418-beef-db3a40aa9c6f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.596247 Aug 08 13:36:15.179934 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 63/139] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:14 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:15.192039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:15.193576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:15.221070 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:15.221643 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:15.222149 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:15.222978 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:15.223478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:15.224078 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:15.224430 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-519691e1-e656-43cc-9c08-cdd4e7ca09fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:15.257285 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-519691e1-e656-43cc-9c08-cdd4e7ca09fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.631152 Aug 08 13:36:15.263513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 77/140] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:14 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:15.390580 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8a877df8-237c-4053-954e-666e5ee67464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:15.395548 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8a877df8-237c-4053-954e-666e5ee67464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:15.418289 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a877df8-237c-4053-954e-666e5ee67464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:15.419133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a877df8-237c-4053-954e-666e5ee67464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:15.419885 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a877df8-237c-4053-954e-666e5ee67464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:15.436669 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a877df8-237c-4053-954e-666e5ee67464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:15.438007 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a877df8-237c-4053-954e-666e5ee67464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:15.439001 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a877df8-237c-4053-954e-666e5ee67464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:15.525164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:15.549146 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:15.565153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:15.566759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7859902e-63b9-486b-83bb-0cd0284f43b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1332 microversion: 2.20 time: 0.385074 Aug 08 13:36:15.581330 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 64/141] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:15 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1332 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:15.606933 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-86a73448-3635-49d8-9340-3502711b2200 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:15.608566 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-86a73448-3635-49d8-9340-3502711b2200 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:15.674195 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-86a73448-3635-49d8-9340-3502711b2200 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:15.675637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-86a73448-3635-49d8-9340-3502711b2200 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:15.676648 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-86a73448-3635-49d8-9340-3502711b2200 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:15.678114 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-86a73448-3635-49d8-9340-3502711b2200 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:15.679197 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-86a73448-3635-49d8-9340-3502711b2200 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:15.683585 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-86a73448-3635-49d8-9340-3502711b2200 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:16.084110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8a877df8-237c-4053-954e-666e5ee67464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:16.120845 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8a877df8-237c-4053-954e-666e5ee67464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.742306 Aug 08 13:36:16.121626 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 78/142] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:15 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:16.122160 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-86a73448-3635-49d8-9340-3502711b2200 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:16.149088 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-86a73448-3635-49d8-9340-3502711b2200 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.559093 Aug 08 13:36:16.173317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 65/143] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:15 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:16.216016 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-39197373-3470-42c2-8b1d-fdd6b460af4f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:16.216785 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-39197373-3470-42c2-8b1d-fdd6b460af4f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:16.224526 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39197373-3470-42c2-8b1d-fdd6b460af4f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:16.225003 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39197373-3470-42c2-8b1d-fdd6b460af4f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:16.225528 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39197373-3470-42c2-8b1d-fdd6b460af4f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:16.226243 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39197373-3470-42c2-8b1d-fdd6b460af4f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:16.226727 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39197373-3470-42c2-8b1d-fdd6b460af4f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:16.227214 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39197373-3470-42c2-8b1d-fdd6b460af4f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:16.290622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6dbb72ab-a25c-46b0-ae53-5724cf6d1c7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:16.291758 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6dbb72ab-a25c-46b0-ae53-5724cf6d1c7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:16.302326 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6dbb72ab-a25c-46b0-ae53-5724cf6d1c7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:16.303476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6dbb72ab-a25c-46b0-ae53-5724cf6d1c7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:16.304161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6dbb72ab-a25c-46b0-ae53-5724cf6d1c7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:16.305308 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6dbb72ab-a25c-46b0-ae53-5724cf6d1c7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:16.306025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6dbb72ab-a25c-46b0-ae53-5724cf6d1c7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:16.306676 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6dbb72ab-a25c-46b0-ae53-5724cf6d1c7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:16.436000 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-39197373-3470-42c2-8b1d-fdd6b460af4f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:16.444446 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-39197373-3470-42c2-8b1d-fdd6b460af4f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.233689 Aug 08 13:36:16.445015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 79/144] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:16 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:16.497667 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6dbb72ab-a25c-46b0-ae53-5724cf6d1c7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:16.506374 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6dbb72ab-a25c-46b0-ae53-5724cf6d1c7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.222945 Aug 08 13:36:16.507008 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 66/145] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:16 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:16.594846 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:16.595520 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:16.605991 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:16.607375 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:16.608147 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:16.609803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:16.610324 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:16.610784 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:16.683458 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:16.692285 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:16.693930 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:16.695155 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0ff367e0-814f-46b3-9c05-26f4e14bbb21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1338 microversion: 2.20 time: 0.104945 Aug 08 13:36:16.696454 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 80/146] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:16 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:17.153915 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-668127e3-1e2d-4b11-92eb-ea291c9f4110 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:17.154907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-668127e3-1e2d-4b11-92eb-ea291c9f4110 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:17.163423 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-668127e3-1e2d-4b11-92eb-ea291c9f4110 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:17.164190 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-668127e3-1e2d-4b11-92eb-ea291c9f4110 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:17.165067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-668127e3-1e2d-4b11-92eb-ea291c9f4110 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:17.166381 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-668127e3-1e2d-4b11-92eb-ea291c9f4110 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:17.167297 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-668127e3-1e2d-4b11-92eb-ea291c9f4110 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:17.168161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-668127e3-1e2d-4b11-92eb-ea291c9f4110 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:17.187225 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-bd74c9e7-0e08-4196-bedb-ef5eea82ca8d tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:17.189551 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-bd74c9e7-0e08-4196-bedb-ef5eea82ca8d tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:17.202774 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bd74c9e7-0e08-4196-bedb-ef5eea82ca8d tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:17.203523 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bd74c9e7-0e08-4196-bedb-ef5eea82ca8d tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:17.204975 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bd74c9e7-0e08-4196-bedb-ef5eea82ca8d tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:17.209118 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bd74c9e7-0e08-4196-bedb-ef5eea82ca8d tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:17.211201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bd74c9e7-0e08-4196-bedb-ef5eea82ca8d tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:17.211985 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bd74c9e7-0e08-4196-bedb-ef5eea82ca8d tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:17.542935 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-668127e3-1e2d-4b11-92eb-ea291c9f4110 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:17.551510 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-668127e3-1e2d-4b11-92eb-ea291c9f4110 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.402129 Aug 08 13:36:17.552395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 67/147] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:17 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:17.557379 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b9207869-6bf1-4b5b-8632-31c2c68156d2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:17.557992 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b9207869-6bf1-4b5b-8632-31c2c68156d2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:17.565311 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b9207869-6bf1-4b5b-8632-31c2c68156d2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:17.565672 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-bd74c9e7-0e08-4196-bedb-ef5eea82ca8d tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:17.565990 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b9207869-6bf1-4b5b-8632-31c2c68156d2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:17.566391 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b9207869-6bf1-4b5b-8632-31c2c68156d2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:17.567113 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b9207869-6bf1-4b5b-8632-31c2c68156d2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:17.567721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b9207869-6bf1-4b5b-8632-31c2c68156d2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:17.568276 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b9207869-6bf1-4b5b-8632-31c2c68156d2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:17.578013 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-bd74c9e7-0e08-4196-bedb-ef5eea82ca8d tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.399201 Aug 08 13:36:17.578639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 81/148] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:17 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:17.583560 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3b8968c3-fd07-48b2-b6b2-c3a19d28586e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:17.584428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3b8968c3-fd07-48b2-b6b2-c3a19d28586e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:17.591743 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3b8968c3-fd07-48b2-b6b2-c3a19d28586e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:17.592222 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3b8968c3-fd07-48b2-b6b2-c3a19d28586e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:17.592855 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3b8968c3-fd07-48b2-b6b2-c3a19d28586e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:17.593578 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3b8968c3-fd07-48b2-b6b2-c3a19d28586e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:17.594023 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3b8968c3-fd07-48b2-b6b2-c3a19d28586e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:17.594483 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3b8968c3-fd07-48b2-b6b2-c3a19d28586e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:17.829714 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b9207869-6bf1-4b5b-8632-31c2c68156d2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:17.835163 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3b8968c3-fd07-48b2-b6b2-c3a19d28586e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:17.839147 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b9207869-6bf1-4b5b-8632-31c2c68156d2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.285891 Aug 08 13:36:17.839922 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 68/149] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:17 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:17.845652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:17.846664 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:17.847875 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3b8968c3-fd07-48b2-b6b2-c3a19d28586e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.267599 Aug 08 13:36:17.849367 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 82/150] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:17 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:17.857542 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:17.858411 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:17.859232 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:17.860836 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:17.861921 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:17.862722 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:17.951359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:17.961653 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:17.963427 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:17.964680 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ca06f0bc-ca0f-40b1-bee9-7aca216ad4e5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1338 microversion: 2.20 time: 0.123668 Aug 08 13:36:17.965307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 69/151] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:17 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1338 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:18.582153 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-62709291-419b-43f2-9108-b1a845cf716b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:18.582912 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-62709291-419b-43f2-9108-b1a845cf716b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:18.590093 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62709291-419b-43f2-9108-b1a845cf716b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:18.590646 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62709291-419b-43f2-9108-b1a845cf716b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:18.591119 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62709291-419b-43f2-9108-b1a845cf716b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:18.591944 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62709291-419b-43f2-9108-b1a845cf716b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:18.592496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62709291-419b-43f2-9108-b1a845cf716b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:18.593121 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62709291-419b-43f2-9108-b1a845cf716b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:18.605519 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6285729e-90b3-4de6-a9f3-9ae0cbadf66f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:18.606417 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6285729e-90b3-4de6-a9f3-9ae0cbadf66f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:18.615683 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6285729e-90b3-4de6-a9f3-9ae0cbadf66f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:18.616401 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6285729e-90b3-4de6-a9f3-9ae0cbadf66f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:18.617099 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6285729e-90b3-4de6-a9f3-9ae0cbadf66f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:18.618259 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6285729e-90b3-4de6-a9f3-9ae0cbadf66f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:18.618975 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6285729e-90b3-4de6-a9f3-9ae0cbadf66f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:18.619688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6285729e-90b3-4de6-a9f3-9ae0cbadf66f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:19.034652 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-62709291-419b-43f2-9108-b1a845cf716b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:19.044229 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-62709291-419b-43f2-9108-b1a845cf716b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.466839 Aug 08 13:36:19.044936 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 83/152] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:18 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:19.053888 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6060d330-f723-4dc7-94e1-6cc4fafa32d9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:19.055030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6060d330-f723-4dc7-94e1-6cc4fafa32d9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:19.056982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6285729e-90b3-4de6-a9f3-9ae0cbadf66f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:19.067666 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6060d330-f723-4dc7-94e1-6cc4fafa32d9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:19.068290 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6285729e-90b3-4de6-a9f3-9ae0cbadf66f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.467085 Aug 08 13:36:19.068530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6060d330-f723-4dc7-94e1-6cc4fafa32d9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:19.069300 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6060d330-f723-4dc7-94e1-6cc4fafa32d9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:19.071195 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6060d330-f723-4dc7-94e1-6cc4fafa32d9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:19.072063 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6060d330-f723-4dc7-94e1-6cc4fafa32d9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:19.072798 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6060d330-f723-4dc7-94e1-6cc4fafa32d9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:19.082419 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 70/153] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:18 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:19.083740 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=100 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:19.092767 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0b538229-e3a5-4b6b-9d0b-0c48862320dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:19.093482 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0b538229-e3a5-4b6b-9d0b-0c48862320dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:19.101874 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b538229-e3a5-4b6b-9d0b-0c48862320dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:19.102412 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b538229-e3a5-4b6b-9d0b-0c48862320dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:19.102908 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b538229-e3a5-4b6b-9d0b-0c48862320dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:19.103742 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b538229-e3a5-4b6b-9d0b-0c48862320dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:19.104438 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b538229-e3a5-4b6b-9d0b-0c48862320dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:19.105084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b538229-e3a5-4b6b-9d0b-0c48862320dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:19.318623 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6060d330-f723-4dc7-94e1-6cc4fafa32d9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:19.328377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6060d330-f723-4dc7-94e1-6cc4fafa32d9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.281967 Aug 08 13:36:19.329434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 84/154] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:19 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:19.334516 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0b538229-e3a5-4b6b-9d0b-0c48862320dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:19.334778 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:19.335332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:19.343156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:19.343784 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:19.344362 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:19.345169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:19.345767 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:19.346171 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:19.351100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0b538229-e3a5-4b6b-9d0b-0c48862320dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.265626 Aug 08 13:36:19.352657 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 71/155] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:19 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:19.422712 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:19.432454 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:19.433945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:19.435514 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7de80e60-852b-47d4-8337-ecd47914510e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1338 microversion: 2.20 time: 0.104698 Aug 08 13:36:19.436099 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 85/156] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:19 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:20.077356 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-90d098a8-3282-44f5-b424-d4d1e0eab36b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:20.078014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-90d098a8-3282-44f5-b424-d4d1e0eab36b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:20.085883 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90d098a8-3282-44f5-b424-d4d1e0eab36b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.086670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90d098a8-3282-44f5-b424-d4d1e0eab36b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.087387 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90d098a8-3282-44f5-b424-d4d1e0eab36b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.088502 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90d098a8-3282-44f5-b424-d4d1e0eab36b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.089228 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90d098a8-3282-44f5-b424-d4d1e0eab36b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.089914 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90d098a8-3282-44f5-b424-d4d1e0eab36b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.093997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-81b3d3d9-ffaa-4ef7-b47f-f03f61e82166 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:20.095253 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-81b3d3d9-ffaa-4ef7-b47f-f03f61e82166 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:20.104491 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81b3d3d9-ffaa-4ef7-b47f-f03f61e82166 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.105265 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81b3d3d9-ffaa-4ef7-b47f-f03f61e82166 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.105944 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81b3d3d9-ffaa-4ef7-b47f-f03f61e82166 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.107097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81b3d3d9-ffaa-4ef7-b47f-f03f61e82166 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.108031 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81b3d3d9-ffaa-4ef7-b47f-f03f61e82166 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.108733 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81b3d3d9-ffaa-4ef7-b47f-f03f61e82166 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.323752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-90d098a8-3282-44f5-b424-d4d1e0eab36b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:20.333651 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-90d098a8-3282-44f5-b424-d4d1e0eab36b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.260114 Aug 08 13:36:20.334266 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 72/157] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:20 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:20.338470 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-81b3d3d9-ffaa-4ef7-b47f-f03f61e82166 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:20.347146 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-81b3d3d9-ffaa-4ef7-b47f-f03f61e82166 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.260198 Aug 08 13:36:20.347973 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 86/158] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:20 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:20.362072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-abcb8551-3cac-49b7-b0ce-6ff05432d520 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:20.362716 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-abcb8551-3cac-49b7-b0ce-6ff05432d520 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:20.369914 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-abcb8551-3cac-49b7-b0ce-6ff05432d520 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.370424 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-abcb8551-3cac-49b7-b0ce-6ff05432d520 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.370841 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-abcb8551-3cac-49b7-b0ce-6ff05432d520 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.371859 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-abcb8551-3cac-49b7-b0ce-6ff05432d520 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.372495 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-abcb8551-3cac-49b7-b0ce-6ff05432d520 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.372951 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-abcb8551-3cac-49b7-b0ce-6ff05432d520 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.379605 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-02219a93-bad9-439b-a946-1856fc5f76a0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:20.380405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-02219a93-bad9-439b-a946-1856fc5f76a0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:20.390636 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02219a93-bad9-439b-a946-1856fc5f76a0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.391130 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02219a93-bad9-439b-a946-1856fc5f76a0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.391710 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02219a93-bad9-439b-a946-1856fc5f76a0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.393528 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02219a93-bad9-439b-a946-1856fc5f76a0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.393528 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02219a93-bad9-439b-a946-1856fc5f76a0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.394304 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02219a93-bad9-439b-a946-1856fc5f76a0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.616871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-abcb8551-3cac-49b7-b0ce-6ff05432d520 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:20.642340 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-abcb8551-3cac-49b7-b0ce-6ff05432d520 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.283885 Aug 08 13:36:20.643654 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 73/159] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:20 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:20.644700 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-02219a93-bad9-439b-a946-1856fc5f76a0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:20.654872 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:20.656890 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:20.660453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-02219a93-bad9-439b-a946-1856fc5f76a0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.289747 Aug 08 13:36:20.661899 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 87/160] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:20 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:20.671014 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-2044ec0f-d66d-47dc-abeb-9cc0bc92a7af req-fe27ab24-c793-4186-a370-e4098e3ba73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ef4518-23e7-4182-8a95-59a287fe5eff", "name": "network-vif-plugged", "status": "completed", "tag": "ff67f5bc-bd23-4f24-bcc8-fb3ea1bcb89b"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:20.688387 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-2044ec0f-d66d-47dc-abeb-9cc0bc92a7af req-fe27ab24-c793-4186-a370-e4098e3ba73a service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.688839 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.689337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.689513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-2044ec0f-d66d-47dc-abeb-9cc0bc92a7af req-fe27ab24-c793-4186-a370-e4098e3ba73a service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.689768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.690240 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-2044ec0f-d66d-47dc-abeb-9cc0bc92a7af req-fe27ab24-c793-4186-a370-e4098e3ba73a service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.690633 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:20.691102 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:20.691530 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:20.708833 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:20.710445 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-2044ec0f-d66d-47dc-abeb-9cc0bc92a7af req-fe27ab24-c793-4186-a370-e4098e3ba73a service nova] Creating event network-vif-plugged:ff67f5bc-bd23-4f24-bcc8-fb3ea1bcb89b for instance a4ef4518-23e7-4182-8a95-59a287fe5eff on hv-cinder-85199 Aug 08 13:36:20.719023 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-2044ec0f-d66d-47dc-abeb-9cc0bc92a7af req-fe27ab24-c793-4186-a370-e4098e3ba73a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054627 Aug 08 13:36:20.720163 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 88/161] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:20.762783 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:20.779399 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:20.782562 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:20.784674 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2825718c-598d-4653-a2ef-bba19bf04272 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1338 microversion: 2.20 time: 0.138748 Aug 08 13:36:20.785896 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 74/162] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:20 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1338 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:21.361790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9553ff3f-5c44-46bc-b93a-da97e05c0875 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:21.362986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9553ff3f-5c44-46bc-b93a-da97e05c0875 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:21.378948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9553ff3f-5c44-46bc-b93a-da97e05c0875 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:21.378948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9553ff3f-5c44-46bc-b93a-da97e05c0875 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:21.378948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9553ff3f-5c44-46bc-b93a-da97e05c0875 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:21.378948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9553ff3f-5c44-46bc-b93a-da97e05c0875 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:21.379587 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9553ff3f-5c44-46bc-b93a-da97e05c0875 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:21.379587 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9553ff3f-5c44-46bc-b93a-da97e05c0875 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:21.385762 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-24bec23e-6b34-469c-a12f-f951259fa3b3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:21.386689 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-24bec23e-6b34-469c-a12f-f951259fa3b3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:21.398084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-24bec23e-6b34-469c-a12f-f951259fa3b3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:21.399130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-24bec23e-6b34-469c-a12f-f951259fa3b3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:21.399872 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-24bec23e-6b34-469c-a12f-f951259fa3b3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:21.400837 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-24bec23e-6b34-469c-a12f-f951259fa3b3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:21.401428 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-24bec23e-6b34-469c-a12f-f951259fa3b3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:21.402113 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-24bec23e-6b34-469c-a12f-f951259fa3b3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:21.640964 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9553ff3f-5c44-46bc-b93a-da97e05c0875 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:21.650366 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-24bec23e-6b34-469c-a12f-f951259fa3b3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:21.655316 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9553ff3f-5c44-46bc-b93a-da97e05c0875 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.300246 Aug 08 13:36:21.667247 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-24bec23e-6b34-469c-a12f-f951259fa3b3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.283439 Aug 08 13:36:21.667564 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 89/163] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:21 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:21.667709 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 75/164] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:21 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:21.685309 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fdefb66a-86f0-40f8-a9a3-7b4ba9775b03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:21.686319 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fdefb66a-86f0-40f8-a9a3-7b4ba9775b03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:21.697346 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b856727a-955f-466d-a3c4-049a80f8b697 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:21.698621 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b856727a-955f-466d-a3c4-049a80f8b697 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:21.702955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdefb66a-86f0-40f8-a9a3-7b4ba9775b03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:21.704258 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdefb66a-86f0-40f8-a9a3-7b4ba9775b03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:21.705605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdefb66a-86f0-40f8-a9a3-7b4ba9775b03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:21.707653 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdefb66a-86f0-40f8-a9a3-7b4ba9775b03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:21.708984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdefb66a-86f0-40f8-a9a3-7b4ba9775b03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:21.710030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdefb66a-86f0-40f8-a9a3-7b4ba9775b03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:21.710302 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b856727a-955f-466d-a3c4-049a80f8b697 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:21.711393 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b856727a-955f-466d-a3c4-049a80f8b697 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:21.712401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b856727a-955f-466d-a3c4-049a80f8b697 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:21.714823 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b856727a-955f-466d-a3c4-049a80f8b697 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:21.716576 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b856727a-955f-466d-a3c4-049a80f8b697 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:21.717345 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b856727a-955f-466d-a3c4-049a80f8b697 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:22.075496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b856727a-955f-466d-a3c4-049a80f8b697 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:22.083224 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fdefb66a-86f0-40f8-a9a3-7b4ba9775b03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:22.084832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b856727a-955f-466d-a3c4-049a80f8b697 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.409575 Aug 08 13:36:22.085439 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 90/165] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:21 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:22.090321 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:22.090933 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:22.097725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:22.098209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:22.098391 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fdefb66a-86f0-40f8-a9a3-7b4ba9775b03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.418660 Aug 08 13:36:22.098701 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:22.099543 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:22.099993 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:22.100164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 76/166] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:21 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:22.100446 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:22.167484 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:22.176372 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:22.177910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:22.179070 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9bcbc0eb-cbde-4c0d-81f4-ae13d8e3c1fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1338 microversion: 2.20 time: 0.092680 Aug 08 13:36:22.179768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 91/167] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:22 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1338 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:22.681063 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ff887f20-cd8d-415f-8c02-28f639a43055 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:22.681689 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ff887f20-cd8d-415f-8c02-28f639a43055 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:22.688495 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff887f20-cd8d-415f-8c02-28f639a43055 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:22.688964 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff887f20-cd8d-415f-8c02-28f639a43055 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:22.689421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff887f20-cd8d-415f-8c02-28f639a43055 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:22.690133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff887f20-cd8d-415f-8c02-28f639a43055 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:22.690587 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff887f20-cd8d-415f-8c02-28f639a43055 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:22.691012 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff887f20-cd8d-415f-8c02-28f639a43055 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:22.706941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8d9ed6c9-f7b2-49c5-9d60-5a0be835f905 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:22.708040 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8d9ed6c9-f7b2-49c5-9d60-5a0be835f905 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:22.717903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d9ed6c9-f7b2-49c5-9d60-5a0be835f905 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:22.718697 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d9ed6c9-f7b2-49c5-9d60-5a0be835f905 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:22.719441 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d9ed6c9-f7b2-49c5-9d60-5a0be835f905 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:22.720565 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d9ed6c9-f7b2-49c5-9d60-5a0be835f905 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:22.721154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d9ed6c9-f7b2-49c5-9d60-5a0be835f905 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:22.721807 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d9ed6c9-f7b2-49c5-9d60-5a0be835f905 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:22.934092 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ff887f20-cd8d-415f-8c02-28f639a43055 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:22.941427 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8d9ed6c9-f7b2-49c5-9d60-5a0be835f905 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:22.946600 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ff887f20-cd8d-415f-8c02-28f639a43055 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.269448 Aug 08 13:36:22.947549 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 77/168] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:22 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:22.968366 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8d9ed6c9-f7b2-49c5-9d60-5a0be835f905 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.268103 Aug 08 13:36:22.969248 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 92/169] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:22 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:23.124853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ac638957-f785-4c65-8b37-385cefb90e63 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:23.125907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c994f2d5-3189-4da2-824f-bb20e2ff6db4 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:23.126026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ac638957-f785-4c65-8b37-385cefb90e63 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:23.127228 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c994f2d5-3189-4da2-824f-bb20e2ff6db4 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:23.136130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac638957-f785-4c65-8b37-385cefb90e63 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:23.136392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c994f2d5-3189-4da2-824f-bb20e2ff6db4 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:23.136908 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac638957-f785-4c65-8b37-385cefb90e63 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:23.137133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c994f2d5-3189-4da2-824f-bb20e2ff6db4 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:23.137604 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac638957-f785-4c65-8b37-385cefb90e63 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:23.137810 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c994f2d5-3189-4da2-824f-bb20e2ff6db4 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:23.138756 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac638957-f785-4c65-8b37-385cefb90e63 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:23.138955 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c994f2d5-3189-4da2-824f-bb20e2ff6db4 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:23.139517 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac638957-f785-4c65-8b37-385cefb90e63 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:23.139690 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c994f2d5-3189-4da2-824f-bb20e2ff6db4 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:23.140193 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac638957-f785-4c65-8b37-385cefb90e63 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:23.140333 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c994f2d5-3189-4da2-824f-bb20e2ff6db4 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:23.353616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ac638957-f785-4c65-8b37-385cefb90e63 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:23.362190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c994f2d5-3189-4da2-824f-bb20e2ff6db4 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:23.362395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ac638957-f785-4c65-8b37-385cefb90e63 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.244003 Aug 08 13:36:23.362864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 78/170] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:23 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:23.368058 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:23.368654 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:23.372391 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c994f2d5-3189-4da2-824f-bb20e2ff6db4 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.252841 Aug 08 13:36:23.373277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 93/171] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:23 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:23.386146 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:23.386827 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:23.387465 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:23.388553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:23.389105 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:23.389662 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:23.463762 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:23.473942 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:23.475625 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:23.476779 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7adcbdba-9227-4e68-84e6-2e6e3690b1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1338 microversion: 2.20 time: 0.112901 Aug 08 13:36:23.477481 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 79/172] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:23 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1338 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:23.984531 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-407dd019-72fb-4ad1-84ed-2a829f753dd2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:23.985662 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-407dd019-72fb-4ad1-84ed-2a829f753dd2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:23.997331 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-407dd019-72fb-4ad1-84ed-2a829f753dd2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:23.998207 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-407dd019-72fb-4ad1-84ed-2a829f753dd2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:23.999183 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-407dd019-72fb-4ad1-84ed-2a829f753dd2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:24.000737 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-407dd019-72fb-4ad1-84ed-2a829f753dd2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:24.001668 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-407dd019-72fb-4ad1-84ed-2a829f753dd2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:24.003681 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-407dd019-72fb-4ad1-84ed-2a829f753dd2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:24.009871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6a07ffa8-8a53-4a22-b21e-8f2bac66c4cc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:24.010923 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6a07ffa8-8a53-4a22-b21e-8f2bac66c4cc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:24.019844 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a07ffa8-8a53-4a22-b21e-8f2bac66c4cc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:24.020611 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a07ffa8-8a53-4a22-b21e-8f2bac66c4cc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:24.021618 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a07ffa8-8a53-4a22-b21e-8f2bac66c4cc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:24.023157 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a07ffa8-8a53-4a22-b21e-8f2bac66c4cc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:24.024205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a07ffa8-8a53-4a22-b21e-8f2bac66c4cc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:24.025785 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a07ffa8-8a53-4a22-b21e-8f2bac66c4cc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:24.248329 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-407dd019-72fb-4ad1-84ed-2a829f753dd2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:24.258258 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-407dd019-72fb-4ad1-84ed-2a829f753dd2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.280902 Aug 08 13:36:24.259062 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 94/173] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:23 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:24.262894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6a07ffa8-8a53-4a22-b21e-8f2bac66c4cc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:24.276480 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6a07ffa8-8a53-4a22-b21e-8f2bac66c4cc tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.288370 Aug 08 13:36:24.277627 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 80/174] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:23 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:24.394036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9900c11b-84b0-4616-9a2d-cdd78e698666 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:24.394668 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9900c11b-84b0-4616-9a2d-cdd78e698666 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:24.399361 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-76276031-7d66-4910-8014-483909d1e9db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:24.400581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-76276031-7d66-4910-8014-483909d1e9db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:24.401742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9900c11b-84b0-4616-9a2d-cdd78e698666 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:24.402239 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9900c11b-84b0-4616-9a2d-cdd78e698666 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:24.402677 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9900c11b-84b0-4616-9a2d-cdd78e698666 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:24.403509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9900c11b-84b0-4616-9a2d-cdd78e698666 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:24.403974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9900c11b-84b0-4616-9a2d-cdd78e698666 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:24.404397 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9900c11b-84b0-4616-9a2d-cdd78e698666 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:24.411652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76276031-7d66-4910-8014-483909d1e9db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:24.412494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76276031-7d66-4910-8014-483909d1e9db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:24.413253 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76276031-7d66-4910-8014-483909d1e9db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:24.414537 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76276031-7d66-4910-8014-483909d1e9db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:24.415352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76276031-7d66-4910-8014-483909d1e9db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:24.416099 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76276031-7d66-4910-8014-483909d1e9db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:24.625741 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9900c11b-84b0-4616-9a2d-cdd78e698666 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:24.636035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9900c11b-84b0-4616-9a2d-cdd78e698666 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.246432 Aug 08 13:36:24.636842 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 95/175] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:24 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:24.640985 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-76276031-7d66-4910-8014-483909d1e9db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:24.644650 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:24.645635 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:24.654287 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-76276031-7d66-4910-8014-483909d1e9db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.262365 Aug 08 13:36:24.655366 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 81/176] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:24 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:24.655655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:24.659324 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:24.659324 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:24.659324 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:24.660445 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:24.661288 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:24.755286 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:24.764790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:24.766331 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:24.767554 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f4a12fb1-6495-472b-8071-806d8ddff8c3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1338 microversion: 2.20 time: 0.129459 Aug 08 13:36:24.768125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 96/177] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:24 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1338 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:25.292945 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b7065fd4-8c86-424e-b0f6-64aafc52c15d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:25.293780 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b7065fd4-8c86-424e-b0f6-64aafc52c15d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:25.300241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e4b021c7-5d60-466b-b165-fd181574e383 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:25.301217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e4b021c7-5d60-466b-b165-fd181574e383 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:25.301468 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b7065fd4-8c86-424e-b0f6-64aafc52c15d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:25.302391 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b7065fd4-8c86-424e-b0f6-64aafc52c15d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:25.303153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b7065fd4-8c86-424e-b0f6-64aafc52c15d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:25.304750 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b7065fd4-8c86-424e-b0f6-64aafc52c15d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:25.305816 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b7065fd4-8c86-424e-b0f6-64aafc52c15d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:25.306560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b7065fd4-8c86-424e-b0f6-64aafc52c15d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:25.309775 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4b021c7-5d60-466b-b165-fd181574e383 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:25.310379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4b021c7-5d60-466b-b165-fd181574e383 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:25.310928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4b021c7-5d60-466b-b165-fd181574e383 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:25.311889 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4b021c7-5d60-466b-b165-fd181574e383 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:25.312655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4b021c7-5d60-466b-b165-fd181574e383 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:25.317624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4b021c7-5d60-466b-b165-fd181574e383 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:25.544137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e4b021c7-5d60-466b-b165-fd181574e383 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:25.554182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e4b021c7-5d60-466b-b165-fd181574e383 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.258788 Aug 08 13:36:25.555480 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 97/178] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:25 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:25.560285 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b7065fd4-8c86-424e-b0f6-64aafc52c15d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:25.575214 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b7065fd4-8c86-424e-b0f6-64aafc52c15d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.285581 Aug 08 13:36:25.576241 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 82/179] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:25 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:25.657810 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-22ebffa0-7de5-4c98-a181-317b4b7b3c26 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:25.658505 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-22ebffa0-7de5-4c98-a181-317b4b7b3c26 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:25.665461 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22ebffa0-7de5-4c98-a181-317b4b7b3c26 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:25.665980 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22ebffa0-7de5-4c98-a181-317b4b7b3c26 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:25.666407 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22ebffa0-7de5-4c98-a181-317b4b7b3c26 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:25.667146 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22ebffa0-7de5-4c98-a181-317b4b7b3c26 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:25.667598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22ebffa0-7de5-4c98-a181-317b4b7b3c26 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:25.668015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22ebffa0-7de5-4c98-a181-317b4b7b3c26 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:25.692100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2e2e51e0-8d0e-40a0-9218-4b49f8f14471 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:25.693178 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2e2e51e0-8d0e-40a0-9218-4b49f8f14471 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:25.703283 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e2e51e0-8d0e-40a0-9218-4b49f8f14471 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:25.703964 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e2e51e0-8d0e-40a0-9218-4b49f8f14471 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:25.704707 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e2e51e0-8d0e-40a0-9218-4b49f8f14471 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:25.705939 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e2e51e0-8d0e-40a0-9218-4b49f8f14471 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:25.706776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e2e51e0-8d0e-40a0-9218-4b49f8f14471 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:25.707568 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e2e51e0-8d0e-40a0-9218-4b49f8f14471 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:25.884996 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-22ebffa0-7de5-4c98-a181-317b4b7b3c26 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:25.899687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-22ebffa0-7de5-4c98-a181-317b4b7b3c26 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.245547 Aug 08 13:36:25.916819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 98/180] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:25 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:25.940430 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:25.941461 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:25.952653 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:25.954047 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:25.955125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:25.957115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:25.957831 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:25.959072 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:26.029934 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2e2e51e0-8d0e-40a0-9218-4b49f8f14471 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:26.040375 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2e2e51e0-8d0e-40a0-9218-4b49f8f14471 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.355508 Aug 08 13:36:26.041939 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 83/181] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:25 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:26.083618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:26.101688 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:26.105823 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:26.108606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6fa05f89-8330-4c87-8ce2-44077a11a800 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1338 microversion: 2.20 time: 0.189309 Aug 08 13:36:26.109845 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 99/182] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:25 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1338 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:26.587330 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-654db5c7-3f4b-4c71-8553-830f62f16acb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:26.588590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-654db5c7-3f4b-4c71-8553-830f62f16acb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:26.601266 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9f54d030-3239-4376-a14b-9813379894d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:26.601935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9f54d030-3239-4376-a14b-9813379894d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:26.609222 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9f54d030-3239-4376-a14b-9813379894d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:26.610589 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-654db5c7-3f4b-4c71-8553-830f62f16acb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:26.611189 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-654db5c7-3f4b-4c71-8553-830f62f16acb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:26.611786 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-654db5c7-3f4b-4c71-8553-830f62f16acb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:26.612652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-654db5c7-3f4b-4c71-8553-830f62f16acb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:26.613659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-654db5c7-3f4b-4c71-8553-830f62f16acb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:26.614159 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9f54d030-3239-4376-a14b-9813379894d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:26.615265 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-654db5c7-3f4b-4c71-8553-830f62f16acb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:26.616177 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9f54d030-3239-4376-a14b-9813379894d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:26.620336 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9f54d030-3239-4376-a14b-9813379894d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:26.621242 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9f54d030-3239-4376-a14b-9813379894d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:26.621936 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9f54d030-3239-4376-a14b-9813379894d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:27.363906 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9f54d030-3239-4376-a14b-9813379894d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:27.382363 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-654db5c7-3f4b-4c71-8553-830f62f16acb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:27.398192 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9f54d030-3239-4376-a14b-9813379894d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.800607 Aug 08 13:36:27.402210 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 100/183] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:26 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:27.410952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-654db5c7-3f4b-4c71-8553-830f62f16acb tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1314 microversion: 2.1 time: 0.827633 Aug 08 13:36:27.412649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 84/184] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:26 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:27.419169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fb9d1e15-f482-4cf7-b65f-b88d7bcaf603 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:27.420922 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-fb9d1e15-f482-4cf7-b65f-b88d7bcaf603 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:27.421871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7069abb8-bf44-4bbf-bd7c-0365d61443d7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:27.423176 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7069abb8-bf44-4bbf-bd7c-0365d61443d7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:27.434726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7069abb8-bf44-4bbf-bd7c-0365d61443d7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:27.435608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7069abb8-bf44-4bbf-bd7c-0365d61443d7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:27.436372 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb9d1e15-f482-4cf7-b65f-b88d7bcaf603 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:27.436919 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7069abb8-bf44-4bbf-bd7c-0365d61443d7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:27.437238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb9d1e15-f482-4cf7-b65f-b88d7bcaf603 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:27.438060 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb9d1e15-f482-4cf7-b65f-b88d7bcaf603 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:27.439041 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7069abb8-bf44-4bbf-bd7c-0365d61443d7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:27.439343 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb9d1e15-f482-4cf7-b65f-b88d7bcaf603 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:27.440134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb9d1e15-f482-4cf7-b65f-b88d7bcaf603 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:27.440875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7069abb8-bf44-4bbf-bd7c-0365d61443d7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:27.441188 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb9d1e15-f482-4cf7-b65f-b88d7bcaf603 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:27.441578 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7069abb8-bf44-4bbf-bd7c-0365d61443d7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:27.487694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=100 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:27.939472 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7069abb8-bf44-4bbf-bd7c-0365d61443d7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:27.951170 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7069abb8-bf44-4bbf-bd7c-0365d61443d7 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.535397 Aug 08 13:36:27.953847 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 85/185] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:27 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:27.962866 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:27.967490 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:27.994898 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:28.000741 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:28.001694 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:28.005944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:28.008074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:28.010305 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-fb9d1e15-f482-4cf7-b65f-b88d7bcaf603 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:28.010831 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:28.028561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-fb9d1e15-f482-4cf7-b65f-b88d7bcaf603 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.623244 Aug 08 13:36:28.036288 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 101/186] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:27 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:28.434903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8e646201-2731-48c8-822e-e00d323ee41f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:28.435857 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8e646201-2731-48c8-822e-e00d323ee41f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:28.454580 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e646201-2731-48c8-822e-e00d323ee41f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:28.456215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e646201-2731-48c8-822e-e00d323ee41f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:28.460591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e646201-2731-48c8-822e-e00d323ee41f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:28.463517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e646201-2731-48c8-822e-e00d323ee41f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:28.464841 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e646201-2731-48c8-822e-e00d323ee41f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:28.466567 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e646201-2731-48c8-822e-e00d323ee41f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:28.947321 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:28.950777 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8e646201-2731-48c8-822e-e00d323ee41f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:28.962207 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8e646201-2731-48c8-822e-e00d323ee41f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1502 microversion: 2.1 time: 0.531282 Aug 08 13:36:28.962758 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 102/187] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:28 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1502 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:28.967608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:28.971957 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5c079fb4-1edd-403c-8fb7-ec90d08a4d39 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:28.972612 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5c079fb4-1edd-403c-8fb7-ec90d08a4d39 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:28.973503 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:28.978766 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-63ae50ef-390d-42c4-8a13-284230ae6290 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 1.022107 Aug 08 13:36:28.981045 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 86/188] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:27 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:28.993277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c079fb4-1edd-403c-8fb7-ec90d08a4d39 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:28.994995 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c079fb4-1edd-403c-8fb7-ec90d08a4d39 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:28.998114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c079fb4-1edd-403c-8fb7-ec90d08a4d39 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:28.999058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c079fb4-1edd-403c-8fb7-ec90d08a4d39 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:29.000573 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c079fb4-1edd-403c-8fb7-ec90d08a4d39 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:29.001289 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c079fb4-1edd-403c-8fb7-ec90d08a4d39 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:29.025130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-482f231e-6ea0-49ef-93c6-4be69dc22770 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:29.038658 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-482f231e-6ea0-49ef-93c6-4be69dc22770 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:29.066804 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-482f231e-6ea0-49ef-93c6-4be69dc22770 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:29.069990 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-482f231e-6ea0-49ef-93c6-4be69dc22770 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:29.070887 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-482f231e-6ea0-49ef-93c6-4be69dc22770 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:29.080918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-482f231e-6ea0-49ef-93c6-4be69dc22770 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:29.081779 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-482f231e-6ea0-49ef-93c6-4be69dc22770 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:29.082815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-482f231e-6ea0-49ef-93c6-4be69dc22770 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:29.749428 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-482f231e-6ea0-49ef-93c6-4be69dc22770 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:29.778103 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-482f231e-6ea0-49ef-93c6-4be69dc22770 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.766587 Aug 08 13:36:29.783348 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 87/189] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:28 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:29.803799 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1baa31fb-26aa-446c-828b-9d14e0cd07a6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:29.804988 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1baa31fb-26aa-446c-828b-9d14e0cd07a6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:29.825878 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5c079fb4-1edd-403c-8fb7-ec90d08a4d39 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:29.829955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1baa31fb-26aa-446c-828b-9d14e0cd07a6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:29.830939 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1baa31fb-26aa-446c-828b-9d14e0cd07a6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:29.831761 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1baa31fb-26aa-446c-828b-9d14e0cd07a6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:29.833590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1baa31fb-26aa-446c-828b-9d14e0cd07a6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:29.834261 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5c079fb4-1edd-403c-8fb7-ec90d08a4d39 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.868697 Aug 08 13:36:29.838127 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1baa31fb-26aa-446c-828b-9d14e0cd07a6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:29.841496 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1baa31fb-26aa-446c-828b-9d14e0cd07a6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:29.842146 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 103/190] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:28 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:30.027720 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:30.028496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:30.035921 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:30.036687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:30.037274 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:30.038450 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:30.039347 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:30.040280 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:30.343738 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-1baa31fb-26aa-446c-828b-9d14e0cd07a6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:30.355866 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1baa31fb-26aa-446c-828b-9d14e0cd07a6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.570702 Aug 08 13:36:30.357161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 88/191] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:29 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:30.394836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:30.417906 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:30.422197 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:30.427599 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6aad5a46-db1b-4ea0-b797-86cdb4e5fcc6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.403802 Aug 08 13:36:30.429151 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 104/192] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:30 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:36:30.447861 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-dc2c3c90-556b-4082-9634-8acbc4a0ebe9 req-68652686-5f0c-4912-acfb-dba182027c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b337a957-cd21-4f51-aa36-f64ad24aee7c", "tag": "9caada1c-52b2-4c87-b709-be921f77a3b5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:30.460426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-dc2c3c90-556b-4082-9634-8acbc4a0ebe9 req-68652686-5f0c-4912-acfb-dba182027c7a service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:30.461218 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-dc2c3c90-556b-4082-9634-8acbc4a0ebe9 req-68652686-5f0c-4912-acfb-dba182027c7a service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:30.461949 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-dc2c3c90-556b-4082-9634-8acbc4a0ebe9 req-68652686-5f0c-4912-acfb-dba182027c7a service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:30.477720 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-dc2c3c90-556b-4082-9634-8acbc4a0ebe9 req-68652686-5f0c-4912-acfb-dba182027c7a service nova] Creating event network-changed:9caada1c-52b2-4c87-b709-be921f77a3b5 for instance b337a957-cd21-4f51-aa36-f64ad24aee7c on hv-cinder-85199 Aug 08 13:36:30.485123 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-dc2c3c90-556b-4082-9634-8acbc4a0ebe9 req-68652686-5f0c-4912-acfb-dba182027c7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059702 Aug 08 13:36:30.486359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 89/193] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:36:30.801505 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-20b2f76b-8213-4d54-a2c0-06b7aebe4bb8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff53e8e4-a67a-4e4a-8876-b35b8f03973a"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:30.804097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-20b2f76b-8213-4d54-a2c0-06b7aebe4bb8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:30.820501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20b2f76b-8213-4d54-a2c0-06b7aebe4bb8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:30.820501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20b2f76b-8213-4d54-a2c0-06b7aebe4bb8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:30.820501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20b2f76b-8213-4d54-a2c0-06b7aebe4bb8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:30.821139 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20b2f76b-8213-4d54-a2c0-06b7aebe4bb8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:30.821511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20b2f76b-8213-4d54-a2c0-06b7aebe4bb8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:30.821936 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20b2f76b-8213-4d54-a2c0-06b7aebe4bb8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:30.833784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-958f6459-2cc8-43f5-80dc-14f068dd2ffb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:30.835340 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-958f6459-2cc8-43f5-80dc-14f068dd2ffb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:30.858404 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-958f6459-2cc8-43f5-80dc-14f068dd2ffb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:30.859620 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-958f6459-2cc8-43f5-80dc-14f068dd2ffb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:30.862372 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-958f6459-2cc8-43f5-80dc-14f068dd2ffb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:30.867593 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-958f6459-2cc8-43f5-80dc-14f068dd2ffb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:30.869081 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-958f6459-2cc8-43f5-80dc-14f068dd2ffb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:30.870309 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-958f6459-2cc8-43f5-80dc-14f068dd2ffb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:31.191851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-958f6459-2cc8-43f5-80dc-14f068dd2ffb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:31.202725 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-958f6459-2cc8-43f5-80dc-14f068dd2ffb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.388130 Aug 08 13:36:31.206258 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 90/194] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:30 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:31.223217 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f2147c57-9f9b-4cc5-8df3-0628171c00bb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:31.224158 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f2147c57-9f9b-4cc5-8df3-0628171c00bb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:31.242582 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f2147c57-9f9b-4cc5-8df3-0628171c00bb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:31.243241 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f2147c57-9f9b-4cc5-8df3-0628171c00bb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:31.243803 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f2147c57-9f9b-4cc5-8df3-0628171c00bb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:31.244515 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f2147c57-9f9b-4cc5-8df3-0628171c00bb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:31.245124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f2147c57-9f9b-4cc5-8df3-0628171c00bb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:31.245713 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f2147c57-9f9b-4cc5-8df3-0628171c00bb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:31.493647 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-f2147c57-9f9b-4cc5-8df3-0628171c00bb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:31.496115 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:31.504920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f2147c57-9f9b-4cc5-8df3-0628171c00bb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.297145 Aug 08 13:36:31.505851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 91/195] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:31 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:31.512408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d2f38a06-b805-43fe-8687-5cf27f7d1d7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:31.513393 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d2f38a06-b805-43fe-8687-5cf27f7d1d7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:31.520785 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d2f38a06-b805-43fe-8687-5cf27f7d1d7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:31.521646 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d2f38a06-b805-43fe-8687-5cf27f7d1d7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:31.522759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d2f38a06-b805-43fe-8687-5cf27f7d1d7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:31.523765 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d2f38a06-b805-43fe-8687-5cf27f7d1d7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:31.524603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d2f38a06-b805-43fe-8687-5cf27f7d1d7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:31.525287 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d2f38a06-b805-43fe-8687-5cf27f7d1d7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:31.818743 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d2f38a06-b805-43fe-8687-5cf27f7d1d7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:31.842549 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d2f38a06-b805-43fe-8687-5cf27f7d1d7d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1321 microversion: 2.1 time: 0.333917 Aug 08 13:36:31.844564 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 92/196] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:31 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:31.859904 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:31.861439 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:31.873578 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:31.874461 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:31.875357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:31.876679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:31.877501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:31.878271 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:32.157443 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:32.171206 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:32.174330 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:32.176249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3f6da77a-01e9-4637-86ed-dcb264be1d26 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.329579 Aug 08 13:36:32.177185 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 93/197] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:31 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:32.226934 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c392fb8b-22ca-4ad6-bde4-1b49eacc889d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:32.228139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c392fb8b-22ca-4ad6-bde4-1b49eacc889d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:32.237807 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c392fb8b-22ca-4ad6-bde4-1b49eacc889d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:32.242263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c392fb8b-22ca-4ad6-bde4-1b49eacc889d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:32.242263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c392fb8b-22ca-4ad6-bde4-1b49eacc889d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:32.242263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c392fb8b-22ca-4ad6-bde4-1b49eacc889d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:32.242263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c392fb8b-22ca-4ad6-bde4-1b49eacc889d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:32.242561 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c392fb8b-22ca-4ad6-bde4-1b49eacc889d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:32.470536 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c392fb8b-22ca-4ad6-bde4-1b49eacc889d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:32.490355 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c392fb8b-22ca-4ad6-bde4-1b49eacc889d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.269126 Aug 08 13:36:32.491203 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 94/198] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:32 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:32.544579 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7d5d068f-c76b-419b-937d-fbb6e8b37406 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:32.545453 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7d5d068f-c76b-419b-937d-fbb6e8b37406 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:32.555222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7d5d068f-c76b-419b-937d-fbb6e8b37406 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:32.556055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7d5d068f-c76b-419b-937d-fbb6e8b37406 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:32.556783 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7d5d068f-c76b-419b-937d-fbb6e8b37406 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:32.557964 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7d5d068f-c76b-419b-937d-fbb6e8b37406 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:32.558788 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7d5d068f-c76b-419b-937d-fbb6e8b37406 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:32.559589 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7d5d068f-c76b-419b-937d-fbb6e8b37406 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:32.776795 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7d5d068f-c76b-419b-937d-fbb6e8b37406 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:32.795229 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7d5d068f-c76b-419b-937d-fbb6e8b37406 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.258493 Aug 08 13:36:32.796474 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 95/199] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:32 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:32.869135 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-750e1262-a1ab-442b-b779-d9272555da08 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:32.869985 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-750e1262-a1ab-442b-b779-d9272555da08 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:32.879683 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-750e1262-a1ab-442b-b779-d9272555da08 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:32.880469 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-750e1262-a1ab-442b-b779-d9272555da08 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:32.881136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-750e1262-a1ab-442b-b779-d9272555da08 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:32.882023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-750e1262-a1ab-442b-b779-d9272555da08 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:32.882631 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-750e1262-a1ab-442b-b779-d9272555da08 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:32.883982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-750e1262-a1ab-442b-b779-d9272555da08 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:33.078944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-750e1262-a1ab-442b-b779-d9272555da08 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:33.090690 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-750e1262-a1ab-442b-b779-d9272555da08 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1515 microversion: 2.1 time: 0.227318 Aug 08 13:36:33.092211 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 96/200] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:32 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:33.125523 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-46f9d675-8f44-4819-b54f-410bb8f70262 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:33.130469 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-46f9d675-8f44-4819-b54f-410bb8f70262 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:33.142655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-46f9d675-8f44-4819-b54f-410bb8f70262 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:33.144634 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-46f9d675-8f44-4819-b54f-410bb8f70262 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:33.145921 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-46f9d675-8f44-4819-b54f-410bb8f70262 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:33.147659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-46f9d675-8f44-4819-b54f-410bb8f70262 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:33.148791 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-46f9d675-8f44-4819-b54f-410bb8f70262 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:33.149820 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-46f9d675-8f44-4819-b54f-410bb8f70262 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:33.292445 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-46f9d675-8f44-4819-b54f-410bb8f70262 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lazy-loading 'flavor' on Instance uuid a4ef4518-23e7-4182-8a95-59a287fe5eff {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:36:33.587241 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-46f9d675-8f44-4819-b54f-410bb8f70262 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff/action" status: 200 len: 32 microversion: 2.1 time: 0.472071 Aug 08 13:36:33.589809 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 97/201] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:36:33 2022] POST /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff/action => generated 32 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 13:36:33.597433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:33.598356 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:33.602228 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:33.609595 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:33.610101 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:33.610544 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:33.611326 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:33.611784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:33.612211 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:33.848532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:33.860078 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:33.863937 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:33.866394 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bc0977b6-582c-47a4-a882-5733689e9f3c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.274660 Aug 08 13:36:33.881108 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 98/202] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:33 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:33.893744 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0476e207-0275-4e3b-a9cc-6c61faecb9ad tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:33.896695 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0476e207-0275-4e3b-a9cc-6c61faecb9ad tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:33.905827 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0476e207-0275-4e3b-a9cc-6c61faecb9ad tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:33.906599 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0476e207-0275-4e3b-a9cc-6c61faecb9ad tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:33.907411 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0476e207-0275-4e3b-a9cc-6c61faecb9ad tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:33.908618 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0476e207-0275-4e3b-a9cc-6c61faecb9ad tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:33.909222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0476e207-0275-4e3b-a9cc-6c61faecb9ad tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:33.910083 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0476e207-0275-4e3b-a9cc-6c61faecb9ad tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:34.136677 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0476e207-0275-4e3b-a9cc-6c61faecb9ad tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:34.146263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0476e207-0275-4e3b-a9cc-6c61faecb9ad tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.263300 Aug 08 13:36:34.146950 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 99/203] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:33 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:34.182543 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6b758bfa-0d7b-4338-bffd-f1b3484d77b0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:34.183790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6b758bfa-0d7b-4338-bffd-f1b3484d77b0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:34.195500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6b758bfa-0d7b-4338-bffd-f1b3484d77b0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:34.196127 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6b758bfa-0d7b-4338-bffd-f1b3484d77b0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:34.196741 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6b758bfa-0d7b-4338-bffd-f1b3484d77b0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:34.197569 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6b758bfa-0d7b-4338-bffd-f1b3484d77b0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:34.198251 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6b758bfa-0d7b-4338-bffd-f1b3484d77b0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:34.199184 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6b758bfa-0d7b-4338-bffd-f1b3484d77b0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:34.480426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6b758bfa-0d7b-4338-bffd-f1b3484d77b0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:34.494296 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6b758bfa-0d7b-4338-bffd-f1b3484d77b0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.326379 Aug 08 13:36:34.496427 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 100/204] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:34 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:34.505800 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dfae9649-a80b-488f-8da2-abf1f236b30c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:34.507016 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-dfae9649-a80b-488f-8da2-abf1f236b30c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:34.524014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dfae9649-a80b-488f-8da2-abf1f236b30c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:34.525838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dfae9649-a80b-488f-8da2-abf1f236b30c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:34.527472 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dfae9649-a80b-488f-8da2-abf1f236b30c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:34.528538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dfae9649-a80b-488f-8da2-abf1f236b30c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:34.529878 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dfae9649-a80b-488f-8da2-abf1f236b30c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:34.530468 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dfae9649-a80b-488f-8da2-abf1f236b30c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:34.896085 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-dfae9649-a80b-488f-8da2-abf1f236b30c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:34.910101 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-dfae9649-a80b-488f-8da2-abf1f236b30c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.411522 Aug 08 13:36:34.921017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 101/205] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:34 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:34.934346 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:34.935294 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:34.965556 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:34.967604 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:34.969697 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:34.972695 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:34.975447 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:34.976162 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:35.015672 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-20b2f76b-8213-4d54-a2c0-06b7aebe4bb8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "POST /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.218150 Aug 08 13:36:35.035402 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 105/206] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:36:30 2022] POST /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3/os-volume_attachments => generated 194 bytes in 4239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:35.173596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-24f439e2-d7f3-431c-ac63-2c2ed61aeb24 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:35.174306 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-24f439e2-d7f3-431c-ac63-2c2ed61aeb24 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:35.186298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-24f439e2-d7f3-431c-ac63-2c2ed61aeb24 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:35.186685 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-24f439e2-d7f3-431c-ac63-2c2ed61aeb24 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:35.187197 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-24f439e2-d7f3-431c-ac63-2c2ed61aeb24 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:35.187958 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-24f439e2-d7f3-431c-ac63-2c2ed61aeb24 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:35.188406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-24f439e2-d7f3-431c-ac63-2c2ed61aeb24 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:35.188824 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-24f439e2-d7f3-431c-ac63-2c2ed61aeb24 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:35.533770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:35.553250 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:35.558983 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:35.565187 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fdc60d6e-bb60-4160-9be9-2b0cd05b33ea tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.636027 Aug 08 13:36:35.580458 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 102/207] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:34 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:35.598109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f6735adc-0cd1-4137-9497-3a3f1dd8bbf0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:35.599322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f6735adc-0cd1-4137-9497-3a3f1dd8bbf0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:35.618546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6735adc-0cd1-4137-9497-3a3f1dd8bbf0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:35.619503 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6735adc-0cd1-4137-9497-3a3f1dd8bbf0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:35.620420 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6735adc-0cd1-4137-9497-3a3f1dd8bbf0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:35.621681 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6735adc-0cd1-4137-9497-3a3f1dd8bbf0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:35.622623 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6735adc-0cd1-4137-9497-3a3f1dd8bbf0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:35.623450 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6735adc-0cd1-4137-9497-3a3f1dd8bbf0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:36.397332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-24f439e2-d7f3-431c-ac63-2c2ed61aeb24 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:36.472346 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-24f439e2-d7f3-431c-ac63-2c2ed61aeb24 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 1.303920 Aug 08 13:36:36.473062 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 106/208] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:35 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:36.485432 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f4d18ea4-7593-4150-8cd0-91f5b3b60dc2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:36.492575 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f4d18ea4-7593-4150-8cd0-91f5b3b60dc2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:36.499964 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4d18ea4-7593-4150-8cd0-91f5b3b60dc2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:36.501131 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4d18ea4-7593-4150-8cd0-91f5b3b60dc2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:36.501780 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4d18ea4-7593-4150-8cd0-91f5b3b60dc2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:36.502795 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4d18ea4-7593-4150-8cd0-91f5b3b60dc2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:36.503788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4d18ea4-7593-4150-8cd0-91f5b3b60dc2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:36.504445 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f4d18ea4-7593-4150-8cd0-91f5b3b60dc2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:36.851501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-f6735adc-0cd1-4137-9497-3a3f1dd8bbf0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:36.867071 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f6735adc-0cd1-4137-9497-3a3f1dd8bbf0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 1.285004 Aug 08 13:36:36.868224 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 103/209] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:35 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:36.877510 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-fd66408a-cf9a-4bb3-b46e-4e4b357b9c26 req-d9f46393-08e1-41af-b24c-b7944ced45b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195b877-5ac0-4c2f-94b0-6afebf0a0ad9", "name": "network-vif-plugged", "status": "completed", "tag": "2bfebcac-007b-41e0-a9b7-10b445528bcf"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:36.897747 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-fd66408a-cf9a-4bb3-b46e-4e4b357b9c26 req-d9f46393-08e1-41af-b24c-b7944ced45b8 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:36.898618 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-fd66408a-cf9a-4bb3-b46e-4e4b357b9c26 req-d9f46393-08e1-41af-b24c-b7944ced45b8 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:36.900663 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-fd66408a-cf9a-4bb3-b46e-4e4b357b9c26 req-d9f46393-08e1-41af-b24c-b7944ced45b8 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:36.921663 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-fd66408a-cf9a-4bb3-b46e-4e4b357b9c26 req-d9f46393-08e1-41af-b24c-b7944ced45b8 service nova] Creating event network-vif-plugged:2bfebcac-007b-41e0-a9b7-10b445528bcf for instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 on hv-cinder-85199 Aug 08 13:36:36.934396 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-fd66408a-cf9a-4bb3-b46e-4e4b357b9c26 req-d9f46393-08e1-41af-b24c-b7944ced45b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059086 Aug 08 13:36:36.934396 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 104/210] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:36.943293 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:36.944583 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:36.957100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:36.958091 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:36.959616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:36.960442 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:36.961350 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:36.962168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:37.041125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f4d18ea4-7593-4150-8cd0-91f5b3b60dc2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:37.051750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f4d18ea4-7593-4150-8cd0-91f5b3b60dc2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.575317 Aug 08 13:36:37.062967 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 107/211] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:36 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:37.442441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:37.460336 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:37.463904 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:37.466075 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3ee6f29e-75ea-4f3d-b3e3-bffde8137772 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.531198 Aug 08 13:36:37.467268 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 105/212] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:36 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:37.474079 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-97065509", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "networks": [{"uuid": "09150fa1-6ee9-44f6-a8b5-e2d6557f28b4"}]}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:37.512941 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5f750616-60ba-4a67-aa45-1cefc39d711f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:37.514269 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-5f750616-60ba-4a67-aa45-1cefc39d711f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:37.523824 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5f750616-60ba-4a67-aa45-1cefc39d711f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:37.524631 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5f750616-60ba-4a67-aa45-1cefc39d711f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:37.525307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5f750616-60ba-4a67-aa45-1cefc39d711f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:37.526164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5f750616-60ba-4a67-aa45-1cefc39d711f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:37.526933 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5f750616-60ba-4a67-aa45-1cefc39d711f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:37.527695 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5f750616-60ba-4a67-aa45-1cefc39d711f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:37.567580 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] validate_networks() for [('09150fa1-6ee9-44f6-a8b5-e2d6557f28b4', None, None, None, None, None)] {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:36:38.102156 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-5f750616-60ba-4a67-aa45-1cefc39d711f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:38.119987 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-5f750616-60ba-4a67-aa45-1cefc39d711f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.613943 Aug 08 13:36:38.121284 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 106/213] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:37 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:38.129337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b04f9de6-767d-41ad-a5a4-0f9fd0beebce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:38.130386 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b04f9de6-767d-41ad-a5a4-0f9fd0beebce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:38.140289 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b04f9de6-767d-41ad-a5a4-0f9fd0beebce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:38.141208 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b04f9de6-767d-41ad-a5a4-0f9fd0beebce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:38.141901 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b04f9de6-767d-41ad-a5a4-0f9fd0beebce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:38.142811 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b04f9de6-767d-41ad-a5a4-0f9fd0beebce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:38.143506 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b04f9de6-767d-41ad-a5a4-0f9fd0beebce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:38.144506 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b04f9de6-767d-41ad-a5a4-0f9fd0beebce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:38.201264 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:38.498799 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b04f9de6-767d-41ad-a5a4-0f9fd0beebce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:38.523572 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b04f9de6-767d-41ad-a5a4-0f9fd0beebce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.400832 Aug 08 13:36:38.538314 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 107/214] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:38 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:38.544124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3811fa81-a888-48c4-9084-7ebb58505311 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:38.544932 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3811fa81-a888-48c4-9084-7ebb58505311 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:38.553478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3811fa81-a888-48c4-9084-7ebb58505311 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:38.554415 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3811fa81-a888-48c4-9084-7ebb58505311 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:38.555335 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3811fa81-a888-48c4-9084-7ebb58505311 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:38.556500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3811fa81-a888-48c4-9084-7ebb58505311 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:38.557238 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3811fa81-a888-48c4-9084-7ebb58505311 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:38.557917 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3811fa81-a888-48c4-9084-7ebb58505311 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:38.883030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3811fa81-a888-48c4-9084-7ebb58505311 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:38.891971 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3811fa81-a888-48c4-9084-7ebb58505311 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1363 microversion: 2.1 time: 0.352162 Aug 08 13:36:38.909215 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 108/215] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:38 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:38.914279 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:38.922903 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:38.932396 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:38.933150 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:38.933831 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:38.935104 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:38.935726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:38.936311 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:38.981504 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:36:38.982667 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:36:38.983608 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:36:38.984395 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:36:38.985580 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:36:39.013903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:39.014780 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:39.015407 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:39.016392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:39.016956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:39.017480 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:39.041732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Getting quotas for project 830ccc10c7284fc2942b49cd091e942a. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:36:39.047973 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Getting quotas for user bd8f3afb4bf040c58feb266b45c0f503 and project 830ccc10c7284fc2942b49cd091e942a. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:36:39.061034 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:36:39.063593 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:36:39.147451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-329fb29c-62ae-4ec6-9337-cbe286d03530 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678945 Aug 08 13:36:39.148362 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 108/216] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:36:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 13:36:39.150181 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:39.154142 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-cc4ca38d-f76d-49e1-9141-0c493944b58c req-abcbfd41-78f9-41f8-89fa-c6d55345c2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11502875-0366-4e45-876a-43cbc50f7261", "name": "network-vif-plugged", "status": "completed", "tag": "01423313-09fc-4ac2-a4ed-f147bfe4ee5c"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:39.166616 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-cc4ca38d-f76d-49e1-9141-0c493944b58c req-abcbfd41-78f9-41f8-89fa-c6d55345c2e8 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:39.167127 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-cc4ca38d-f76d-49e1-9141-0c493944b58c req-abcbfd41-78f9-41f8-89fa-c6d55345c2e8 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:39.167726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-cc4ca38d-f76d-49e1-9141-0c493944b58c req-abcbfd41-78f9-41f8-89fa-c6d55345c2e8 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:39.180301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-cc4ca38d-f76d-49e1-9141-0c493944b58c req-abcbfd41-78f9-41f8-89fa-c6d55345c2e8 service nova] Creating event network-vif-plugged:01423313-09fc-4ac2-a4ed-f147bfe4ee5c for instance 11502875-0366-4e45-876a-43cbc50f7261 on hv-cinder-85199 Aug 08 13:36:39.185923 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-cc4ca38d-f76d-49e1-9141-0c493944b58c req-abcbfd41-78f9-41f8-89fa-c6d55345c2e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036052 Aug 08 13:36:39.186526 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 109/217] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:39.191406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:39.194277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fa76ab7e-6c20-4716-b3cd-b1ab5b8fdbc1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:39.195360 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-fa76ab7e-6c20-4716-b3cd-b1ab5b8fdbc1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:39.199481 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:39.201874 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c552e6c1-a5db-4f62-b81c-e39a275a02ef tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.291156 Aug 08 13:36:39.203475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fa76ab7e-6c20-4716-b3cd-b1ab5b8fdbc1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:39.204131 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fa76ab7e-6c20-4716-b3cd-b1ab5b8fdbc1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:39.204718 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fa76ab7e-6c20-4716-b3cd-b1ab5b8fdbc1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:39.205632 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fa76ab7e-6c20-4716-b3cd-b1ab5b8fdbc1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:39.206866 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fa76ab7e-6c20-4716-b3cd-b1ab5b8fdbc1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:39.207577 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fa76ab7e-6c20-4716-b3cd-b1ab5b8fdbc1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:39.221136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 109/218] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:38 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:39.246095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8dced272-6b16-430a-b587-2bb2bde35db6 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:39.247414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8dced272-6b16-430a-b587-2bb2bde35db6 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:39.414120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8dced272-6b16-430a-b587-2bb2bde35db6 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:39.440802 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8dced272-6b16-430a-b587-2bb2bde35db6 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1212 microversion: 2.1 time: 0.217551 Aug 08 13:36:39.445273 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 110/219] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:39 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1212 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:39.511909 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-fa76ab7e-6c20-4716-b3cd-b1ab5b8fdbc1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:39.523375 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-fa76ab7e-6c20-4716-b3cd-b1ab5b8fdbc1 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.334809 Aug 08 13:36:39.525753 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 110/220] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:39 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:39.556492 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ff5a63cb-e1b0-4c2c-b859-c89e294ed2a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:39.557293 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ff5a63cb-e1b0-4c2c-b859-c89e294ed2a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:39.564342 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5a63cb-e1b0-4c2c-b859-c89e294ed2a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:39.564842 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5a63cb-e1b0-4c2c-b859-c89e294ed2a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:39.565284 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5a63cb-e1b0-4c2c-b859-c89e294ed2a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:39.566015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5a63cb-e1b0-4c2c-b859-c89e294ed2a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:39.566722 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5a63cb-e1b0-4c2c-b859-c89e294ed2a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:39.567363 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5a63cb-e1b0-4c2c-b859-c89e294ed2a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:39.811986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ff5a63cb-e1b0-4c2c-b859-c89e294ed2a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:39.832304 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ff5a63cb-e1b0-4c2c-b859-c89e294ed2a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.280592 Aug 08 13:36:39.834185 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 111/221] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:39 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:39.917930 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3ac0f1b8-cc90-43aa-904d-d7068b6030bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:39.918754 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3ac0f1b8-cc90-43aa-904d-d7068b6030bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:39.929956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ac0f1b8-cc90-43aa-904d-d7068b6030bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:39.930567 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ac0f1b8-cc90-43aa-904d-d7068b6030bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:39.930913 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ac0f1b8-cc90-43aa-904d-d7068b6030bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:39.931845 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ac0f1b8-cc90-43aa-904d-d7068b6030bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:39.932316 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ac0f1b8-cc90-43aa-904d-d7068b6030bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:39.932747 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ac0f1b8-cc90-43aa-904d-d7068b6030bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:40.137382 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3ac0f1b8-cc90-43aa-904d-d7068b6030bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:40.149516 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3ac0f1b8-cc90-43aa-904d-d7068b6030bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1549 microversion: 2.1 time: 0.235746 Aug 08 13:36:40.159161 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 111/222] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:39 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1549 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:40.188388 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2f2c55cc-48a5-456a-8e55-c8535f4a1b2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:40.189203 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2f2c55cc-48a5-456a-8e55-c8535f4a1b2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:40.204376 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2c55cc-48a5-456a-8e55-c8535f4a1b2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:40.205291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2c55cc-48a5-456a-8e55-c8535f4a1b2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:40.206431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2c55cc-48a5-456a-8e55-c8535f4a1b2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:40.207922 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2c55cc-48a5-456a-8e55-c8535f4a1b2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:40.208796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2c55cc-48a5-456a-8e55-c8535f4a1b2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:40.209619 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2f2c55cc-48a5-456a-8e55-c8535f4a1b2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:40.264354 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:40.266363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:40.278455 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:40.279302 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:40.280305 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:40.282044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:40.282849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:40.283765 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:40.343681 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2f2c55cc-48a5-456a-8e55-c8535f4a1b2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161748 Aug 08 13:36:40.344542 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 112/223] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 13:36:40 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:40.477785 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b96fc4ed-c110-4c19-94b0-83c672f2c1e1 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:40.478942 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b96fc4ed-c110-4c19-94b0-83c672f2c1e1 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:40.493419 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b96fc4ed-c110-4c19-94b0-83c672f2c1e1 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:40.500039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b96fc4ed-c110-4c19-94b0-83c672f2c1e1 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:40.501088 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b96fc4ed-c110-4c19-94b0-83c672f2c1e1 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:40.503878 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b96fc4ed-c110-4c19-94b0-83c672f2c1e1 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:40.506023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b96fc4ed-c110-4c19-94b0-83c672f2c1e1 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:40.506822 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b96fc4ed-c110-4c19-94b0-83c672f2c1e1 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:41.061092 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b96fc4ed-c110-4c19-94b0-83c672f2c1e1 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:41.069726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b96fc4ed-c110-4c19-94b0-83c672f2c1e1 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1216 microversion: 2.1 time: 0.597694 Aug 08 13:36:41.071807 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 113/224] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:40 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1216 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:41.077272 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2a4dfbfb-b9c1-4028-95cd-21209f45b196 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:41.078439 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2a4dfbfb-b9c1-4028-95cd-21209f45b196 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:41.086088 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2a4dfbfb-b9c1-4028-95cd-21209f45b196 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:41.086958 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2a4dfbfb-b9c1-4028-95cd-21209f45b196 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:41.087667 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2a4dfbfb-b9c1-4028-95cd-21209f45b196 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:41.088598 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2a4dfbfb-b9c1-4028-95cd-21209f45b196 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:41.089317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2a4dfbfb-b9c1-4028-95cd-21209f45b196 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:41.089840 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2a4dfbfb-b9c1-4028-95cd-21209f45b196 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:41.332482 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:41.346118 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:41.349364 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:41.352225 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1077b9c7-8c1b-4ade-8fb1-c3add205ffc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 1.100617 Aug 08 13:36:41.353832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 112/225] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:40 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:41.372409 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-28a26c64-3af8-4277-ae84-c835f681a13f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:41.374050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-28a26c64-3af8-4277-ae84-c835f681a13f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:41.392201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-28a26c64-3af8-4277-ae84-c835f681a13f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:41.393049 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-28a26c64-3af8-4277-ae84-c835f681a13f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:41.393814 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-28a26c64-3af8-4277-ae84-c835f681a13f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:41.395108 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-28a26c64-3af8-4277-ae84-c835f681a13f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:41.395984 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-28a26c64-3af8-4277-ae84-c835f681a13f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:41.396704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-28a26c64-3af8-4277-ae84-c835f681a13f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:41.524934 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2a4dfbfb-b9c1-4028-95cd-21209f45b196 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:41.547377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2a4dfbfb-b9c1-4028-95cd-21209f45b196 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.473334 Aug 08 13:36:41.559171 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 114/226] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:41 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:41.971363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-28a26c64-3af8-4277-ae84-c835f681a13f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:41.981181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-28a26c64-3af8-4277-ae84-c835f681a13f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.625661 Aug 08 13:36:41.984712 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 113/227] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:41 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:42.097911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-50265c74-00f6-469c-814e-9cea21cb14c0 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:42.099257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-50265c74-00f6-469c-814e-9cea21cb14c0 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:42.106253 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-50265c74-00f6-469c-814e-9cea21cb14c0 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:42.106838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-50265c74-00f6-469c-814e-9cea21cb14c0 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:42.107291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-50265c74-00f6-469c-814e-9cea21cb14c0 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:42.108610 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-50265c74-00f6-469c-814e-9cea21cb14c0 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:42.109549 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-50265c74-00f6-469c-814e-9cea21cb14c0 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:42.110207 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-50265c74-00f6-469c-814e-9cea21cb14c0 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:42.205211 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-50265c74-00f6-469c-814e-9cea21cb14c0 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:42.231890 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-50265c74-00f6-469c-814e-9cea21cb14c0 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1216 microversion: 2.1 time: 0.135288 Aug 08 13:36:42.232828 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 115/228] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:42 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:42.392625 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:42.393367 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:42.403501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:42.406074 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:42.408364 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:42.410983 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:42.412690 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:42.413724 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:42.580669 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-761944f8-004f-4086-a20f-d15e038e4c63 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:42.582129 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-761944f8-004f-4086-a20f-d15e038e4c63 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:42.589142 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-761944f8-004f-4086-a20f-d15e038e4c63 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:42.590003 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-761944f8-004f-4086-a20f-d15e038e4c63 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:42.590648 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-761944f8-004f-4086-a20f-d15e038e4c63 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:42.591703 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-761944f8-004f-4086-a20f-d15e038e4c63 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:42.592378 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-761944f8-004f-4086-a20f-d15e038e4c63 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:42.593047 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-761944f8-004f-4086-a20f-d15e038e4c63 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:42.752668 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:42.761095 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:42.762927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:42.764352 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6ae447d2-c546-4204-9c91-4eb717edc651 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.385983 Aug 08 13:36:42.765522 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 114/229] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:42 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:42.930296 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-761944f8-004f-4086-a20f-d15e038e4c63 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:42.944678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-761944f8-004f-4086-a20f-d15e038e4c63 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.367578 Aug 08 13:36:42.946703 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 116/230] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:42 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:43.010352 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f9c7eb09-cece-4374-be34-fb6dc7dd475d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:43.011772 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f9c7eb09-cece-4374-be34-fb6dc7dd475d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:43.023556 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9c7eb09-cece-4374-be34-fb6dc7dd475d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:43.024782 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9c7eb09-cece-4374-be34-fb6dc7dd475d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:43.025533 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9c7eb09-cece-4374-be34-fb6dc7dd475d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:43.026753 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9c7eb09-cece-4374-be34-fb6dc7dd475d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:43.027596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9c7eb09-cece-4374-be34-fb6dc7dd475d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:43.028319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9c7eb09-cece-4374-be34-fb6dc7dd475d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:43.273820 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-584e8a12-dca1-478b-8e12-d25906bc34ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:43.274802 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-584e8a12-dca1-478b-8e12-d25906bc34ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:43.291239 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-584e8a12-dca1-478b-8e12-d25906bc34ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:43.292392 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-584e8a12-dca1-478b-8e12-d25906bc34ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:43.292868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-584e8a12-dca1-478b-8e12-d25906bc34ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:43.295375 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-584e8a12-dca1-478b-8e12-d25906bc34ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:43.296192 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-584e8a12-dca1-478b-8e12-d25906bc34ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:43.296704 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-584e8a12-dca1-478b-8e12-d25906bc34ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:43.439137 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-584e8a12-dca1-478b-8e12-d25906bc34ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:43.470976 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-584e8a12-dca1-478b-8e12-d25906bc34ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1216 microversion: 2.1 time: 0.203848 Aug 08 13:36:43.490376 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 117/231] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:43 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1216 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:43.514986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-9e31ef72-5a33-40b1-97a2-01581548f618 req-746dd705-59c9-4363-b041-2b5014e5b271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3195b877-5ac0-4c2f-94b0-6afebf0a0ad9", "tag": "2bfebcac-007b-41e0-a9b7-10b445528bcf"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:43.526073 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f9c7eb09-cece-4374-be34-fb6dc7dd475d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:43.537946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f9c7eb09-cece-4374-be34-fb6dc7dd475d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.535367 Aug 08 13:36:43.540630 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 115/232] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:43 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:43.555387 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-9e31ef72-5a33-40b1-97a2-01581548f618 req-746dd705-59c9-4363-b041-2b5014e5b271 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:43.555387 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-9e31ef72-5a33-40b1-97a2-01581548f618 req-746dd705-59c9-4363-b041-2b5014e5b271 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:43.555387 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-9e31ef72-5a33-40b1-97a2-01581548f618 req-746dd705-59c9-4363-b041-2b5014e5b271 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:43.584163 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-9e31ef72-5a33-40b1-97a2-01581548f618 req-746dd705-59c9-4363-b041-2b5014e5b271 service nova] Creating event network-changed:2bfebcac-007b-41e0-a9b7-10b445528bcf for instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 on hv-cinder-85199 Aug 08 13:36:43.594441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-9e31ef72-5a33-40b1-97a2-01581548f618 req-746dd705-59c9-4363-b041-2b5014e5b271 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097067 Aug 08 13:36:43.595434 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 118/233] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:43.806940 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:43.807588 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:43.813381 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:43.825694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:43.826183 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:43.826614 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:43.827357 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:43.827891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:43.828302 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:43.987627 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e1510c9b-13f7-46d4-a882-c3469ab5d8b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:43.990341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e1510c9b-13f7-46d4-a882-c3469ab5d8b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:44.016003 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e1510c9b-13f7-46d4-a882-c3469ab5d8b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:44.016638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e1510c9b-13f7-46d4-a882-c3469ab5d8b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:44.022168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e1510c9b-13f7-46d4-a882-c3469ab5d8b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:44.024413 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e1510c9b-13f7-46d4-a882-c3469ab5d8b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:44.026249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e1510c9b-13f7-46d4-a882-c3469ab5d8b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:44.028296 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e1510c9b-13f7-46d4-a882-c3469ab5d8b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:44.649674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:44.652105 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e1510c9b-13f7-46d4-a882-c3469ab5d8b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:44.662066 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e1510c9b-13f7-46d4-a882-c3469ab5d8b2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.685732 Aug 08 13:36:44.662712 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 119/234] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:43 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:44.677969 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-af6d374a-421b-4b6f-a8ff-25c4041360db tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:44.678821 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-af6d374a-421b-4b6f-a8ff-25c4041360db tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:44.686343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-af6d374a-421b-4b6f-a8ff-25c4041360db tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:44.687471 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-af6d374a-421b-4b6f-a8ff-25c4041360db tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:44.688221 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-af6d374a-421b-4b6f-a8ff-25c4041360db tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:44.689169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:44.689531 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-af6d374a-421b-4b6f-a8ff-25c4041360db tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:44.690202 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-af6d374a-421b-4b6f-a8ff-25c4041360db tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:44.690838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-af6d374a-421b-4b6f-a8ff-25c4041360db tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:44.698777 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:44.707128 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-983d254b-c4d9-43bb-a421-45c6129729c0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.905329 Aug 08 13:36:44.713044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 116/235] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:43 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:44.743513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2c1ba340-abd8-4767-9986-7a719da279f6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:44.746337 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2c1ba340-abd8-4767-9986-7a719da279f6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:44.780636 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-af6d374a-421b-4b6f-a8ff-25c4041360db tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:44.792966 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2c1ba340-abd8-4767-9986-7a719da279f6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:44.794252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2c1ba340-abd8-4767-9986-7a719da279f6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:44.794435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-af6d374a-421b-4b6f-a8ff-25c4041360db tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1264 microversion: 2.1 time: 0.121475 Aug 08 13:36:44.795991 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2c1ba340-abd8-4767-9986-7a719da279f6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:44.796663 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 120/236] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:44 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1264 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:44.798027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2c1ba340-abd8-4767-9986-7a719da279f6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:44.804572 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2c1ba340-abd8-4767-9986-7a719da279f6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:44.805494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2c1ba340-abd8-4767-9986-7a719da279f6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:45.036625 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2c1ba340-abd8-4767-9986-7a719da279f6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:45.046382 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2c1ba340-abd8-4767-9986-7a719da279f6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.331377 Aug 08 13:36:45.047398 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 117/237] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:44 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:45.685755 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d00c37fb-0c17-47da-8392-c8fca90f258e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:45.686593 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d00c37fb-0c17-47da-8392-c8fca90f258e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:45.693359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d00c37fb-0c17-47da-8392-c8fca90f258e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:45.693919 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d00c37fb-0c17-47da-8392-c8fca90f258e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:45.694255 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d00c37fb-0c17-47da-8392-c8fca90f258e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:45.694961 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d00c37fb-0c17-47da-8392-c8fca90f258e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:45.695440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d00c37fb-0c17-47da-8392-c8fca90f258e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:45.695862 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d00c37fb-0c17-47da-8392-c8fca90f258e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:45.752181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:45.753086 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:45.761418 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:45.762518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:45.763204 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:45.764398 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:45.765063 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:45.766430 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:45.773440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:45.994012 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d00c37fb-0c17-47da-8392-c8fca90f258e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:46.023585 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d00c37fb-0c17-47da-8392-c8fca90f258e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1366 microversion: 2.1 time: 0.341388 Aug 08 13:36:46.024538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 121/238] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:45 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:46.030058 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-60a2b879-3296-4ba0-bd90-1d28ba46de7c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:46.031250 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-60a2b879-3296-4ba0-bd90-1d28ba46de7c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:46.039015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-60a2b879-3296-4ba0-bd90-1d28ba46de7c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:46.039921 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-60a2b879-3296-4ba0-bd90-1d28ba46de7c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:46.040364 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:46.040855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-60a2b879-3296-4ba0-bd90-1d28ba46de7c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:46.042120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-60a2b879-3296-4ba0-bd90-1d28ba46de7c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:46.042830 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-60a2b879-3296-4ba0-bd90-1d28ba46de7c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:46.043468 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-60a2b879-3296-4ba0-bd90-1d28ba46de7c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:46.053276 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:46.054976 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:46.056318 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c84cdf58-8d54-45c2-8987-56ad849cf152 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.308889 Aug 08 13:36:46.057389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 118/239] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:45 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:46.067417 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-704d5539-b7c1-459b-8738-d3224e11a5d3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:46.067921 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-704d5539-b7c1-459b-8738-d3224e11a5d3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:46.074742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-704d5539-b7c1-459b-8738-d3224e11a5d3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:46.075265 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-704d5539-b7c1-459b-8738-d3224e11a5d3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:46.075707 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-704d5539-b7c1-459b-8738-d3224e11a5d3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:46.076428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-704d5539-b7c1-459b-8738-d3224e11a5d3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:46.076886 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-704d5539-b7c1-459b-8738-d3224e11a5d3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:46.077381 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-704d5539-b7c1-459b-8738-d3224e11a5d3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:46.139281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-60a2b879-3296-4ba0-bd90-1d28ba46de7c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:46.146363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-704d5539-b7c1-459b-8738-d3224e11a5d3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:36:46.173477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-60a2b879-3296-4ba0-bd90-1d28ba46de7c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1272 microversion: 2.1 time: 0.147377 Aug 08 13:36:46.174120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 122/240] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:46 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:46.188194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-11703c68-d8c0-4acf-af0b-4f3caf433308 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:46.189568 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-11703c68-d8c0-4acf-af0b-4f3caf433308 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:46.224712 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-11703c68-d8c0-4acf-af0b-4f3caf433308 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:46.226624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-11703c68-d8c0-4acf-af0b-4f3caf433308 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:46.227763 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-11703c68-d8c0-4acf-af0b-4f3caf433308 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:46.229150 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-11703c68-d8c0-4acf-af0b-4f3caf433308 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:46.230218 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-11703c68-d8c0-4acf-af0b-4f3caf433308 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:46.231429 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-11703c68-d8c0-4acf-af0b-4f3caf433308 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:46.463295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-704d5539-b7c1-459b-8738-d3224e11a5d3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "DELETE /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 204 len: 0 microversion: 2.1 time: 0.403741 Aug 08 13:36:46.464381 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 119/241] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:36:46 2022] DELETE /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:36:46.521437 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b09c7d40-42f2-4edf-addd-0b60b765d81e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:46.522592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b09c7d40-42f2-4edf-addd-0b60b765d81e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:46.546863 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b09c7d40-42f2-4edf-addd-0b60b765d81e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:46.547916 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b09c7d40-42f2-4edf-addd-0b60b765d81e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:46.550921 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b09c7d40-42f2-4edf-addd-0b60b765d81e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:46.552291 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b09c7d40-42f2-4edf-addd-0b60b765d81e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:46.553136 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b09c7d40-42f2-4edf-addd-0b60b765d81e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:46.553911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b09c7d40-42f2-4edf-addd-0b60b765d81e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:46.711621 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-11703c68-d8c0-4acf-af0b-4f3caf433308 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:46.730698 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-11703c68-d8c0-4acf-af0b-4f3caf433308 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.555339 Aug 08 13:36:46.731218 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 123/242] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:46 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:46.736569 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-3dd4ef4b-17d8-4b1f-a4ab-0e0dc631fee4 req-e90763ef-77e7-4d5b-b204-809617d6a91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b337a957-cd21-4f51-aa36-f64ad24aee7c", "name": "network-vif-plugged", "status": "completed", "tag": "9caada1c-52b2-4c87-b709-be921f77a3b5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:46.749060 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-3dd4ef4b-17d8-4b1f-a4ab-0e0dc631fee4 req-e90763ef-77e7-4d5b-b204-809617d6a91c service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:46.749930 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-3dd4ef4b-17d8-4b1f-a4ab-0e0dc631fee4 req-e90763ef-77e7-4d5b-b204-809617d6a91c service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:46.750501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-3dd4ef4b-17d8-4b1f-a4ab-0e0dc631fee4 req-e90763ef-77e7-4d5b-b204-809617d6a91c service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:46.774655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-3dd4ef4b-17d8-4b1f-a4ab-0e0dc631fee4 req-e90763ef-77e7-4d5b-b204-809617d6a91c service nova] Creating event network-vif-plugged:9caada1c-52b2-4c87-b709-be921f77a3b5 for instance b337a957-cd21-4f51-aa36-f64ad24aee7c on hv-cinder-85199 Aug 08 13:36:46.784733 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-3dd4ef4b-17d8-4b1f-a4ab-0e0dc631fee4 req-e90763ef-77e7-4d5b-b204-809617d6a91c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051893 Aug 08 13:36:46.785689 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 124/243] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:46.807359 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b09c7d40-42f2-4edf-addd-0b60b765d81e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:46.815649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b09c7d40-42f2-4edf-addd-0b60b765d81e tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.344073 Aug 08 13:36:46.816279 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 120/244] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:46 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:47.059679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e3ee873d-2b0d-4726-9513-7537ec026645 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:47.060261 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e3ee873d-2b0d-4726-9513-7537ec026645 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:47.067785 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ee873d-2b0d-4726-9513-7537ec026645 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.068391 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ee873d-2b0d-4726-9513-7537ec026645 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.069095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ee873d-2b0d-4726-9513-7537ec026645 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.070165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ee873d-2b0d-4726-9513-7537ec026645 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.070650 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ee873d-2b0d-4726-9513-7537ec026645 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.071437 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ee873d-2b0d-4726-9513-7537ec026645 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.096523 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:47.097355 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:47.104393 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.105175 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.105847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.107731 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.107731 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.107731 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.290251 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e3ee873d-2b0d-4726-9513-7537ec026645 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:47.304125 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e3ee873d-2b0d-4726-9513-7537ec026645 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1555 microversion: 2.1 time: 0.248789 Aug 08 13:36:47.304900 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 125/245] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:47 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:47.319326 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0dbc95d7-ea8f-47a9-927a-55fdd00da9b2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:47.320077 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0dbc95d7-ea8f-47a9-927a-55fdd00da9b2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:47.334218 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:47.336076 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dbc95d7-ea8f-47a9-927a-55fdd00da9b2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.336860 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dbc95d7-ea8f-47a9-927a-55fdd00da9b2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.337567 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dbc95d7-ea8f-47a9-927a-55fdd00da9b2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.338734 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dbc95d7-ea8f-47a9-927a-55fdd00da9b2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.339508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dbc95d7-ea8f-47a9-927a-55fdd00da9b2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.340205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dbc95d7-ea8f-47a9-927a-55fdd00da9b2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.348575 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:47.351006 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:47.357538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-88c23d0a-ea88-4c18-afb9-7476fc7b2fb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.260127 Aug 08 13:36:47.358069 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 121/246] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:47 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:47.368105 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8aa26e7a-6f80-4754-9b9d-7e629f80a34a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:47.368928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8aa26e7a-6f80-4754-9b9d-7e629f80a34a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:47.375489 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:47.380945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8aa26e7a-6f80-4754-9b9d-7e629f80a34a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.381772 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8aa26e7a-6f80-4754-9b9d-7e629f80a34a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.382473 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8aa26e7a-6f80-4754-9b9d-7e629f80a34a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.383548 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8aa26e7a-6f80-4754-9b9d-7e629f80a34a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.384254 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8aa26e7a-6f80-4754-9b9d-7e629f80a34a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.384939 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8aa26e7a-6f80-4754-9b9d-7e629f80a34a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.439048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0dbc95d7-ea8f-47a9-927a-55fdd00da9b2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:47.447236 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0dbc95d7-ea8f-47a9-927a-55fdd00da9b2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1282 microversion: 2.1 time: 0.133425 Aug 08 13:36:47.447843 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 126/247] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:47 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1282 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:47.493473 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8aa26e7a-6f80-4754-9b9d-7e629f80a34a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133408 Aug 08 13:36:47.494073 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 122/248] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 13:36:47 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:47.759907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1b1a46a3-f936-4fdf-8260-a8fa4ab180c1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:47.760724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1b1a46a3-f936-4fdf-8260-a8fa4ab180c1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:47.772681 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1b1a46a3-f936-4fdf-8260-a8fa4ab180c1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.773541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1b1a46a3-f936-4fdf-8260-a8fa4ab180c1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.774154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1b1a46a3-f936-4fdf-8260-a8fa4ab180c1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.776420 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1b1a46a3-f936-4fdf-8260-a8fa4ab180c1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.777064 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1b1a46a3-f936-4fdf-8260-a8fa4ab180c1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.777635 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1b1a46a3-f936-4fdf-8260-a8fa4ab180c1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.837879 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-67e71617-6aa3-426e-baf6-cf74ff538fb5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:47.838502 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-67e71617-6aa3-426e-baf6-cf74ff538fb5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:47.847971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67e71617-6aa3-426e-baf6-cf74ff538fb5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.848813 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67e71617-6aa3-426e-baf6-cf74ff538fb5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.849576 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67e71617-6aa3-426e-baf6-cf74ff538fb5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:47.850773 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67e71617-6aa3-426e-baf6-cf74ff538fb5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:47.851844 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67e71617-6aa3-426e-baf6-cf74ff538fb5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:47.852565 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67e71617-6aa3-426e-baf6-cf74ff538fb5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:48.111840 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-1b1a46a3-f936-4fdf-8260-a8fa4ab180c1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:48.119921 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1b1a46a3-f936-4fdf-8260-a8fa4ab180c1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.367476 Aug 08 13:36:48.120692 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 127/249] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:47 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:48.174322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-67e71617-6aa3-426e-baf6-cf74ff538fb5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:48.183187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-67e71617-6aa3-426e-baf6-cf74ff538fb5 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.349114 Aug 08 13:36:48.183887 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 123/250] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:47 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:48.384840 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:48.385786 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:48.394752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:48.394752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:48.395281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:48.396028 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:48.396494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:48.396869 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:48.479573 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3efe666c-f1be-4ce0-a4fc-fa36e06000e4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:48.480478 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3efe666c-f1be-4ce0-a4fc-fa36e06000e4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:48.491058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3efe666c-f1be-4ce0-a4fc-fa36e06000e4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:48.491058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3efe666c-f1be-4ce0-a4fc-fa36e06000e4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:48.491058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3efe666c-f1be-4ce0-a4fc-fa36e06000e4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:48.491058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3efe666c-f1be-4ce0-a4fc-fa36e06000e4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:48.491543 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3efe666c-f1be-4ce0-a4fc-fa36e06000e4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:48.491543 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3efe666c-f1be-4ce0-a4fc-fa36e06000e4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:48.585726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3efe666c-f1be-4ce0-a4fc-fa36e06000e4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:48.596543 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3efe666c-f1be-4ce0-a4fc-fa36e06000e4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1282 microversion: 2.1 time: 0.120991 Aug 08 13:36:48.597780 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 124/251] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:48 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:48.643478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:48.652399 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:48.653897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:48.655043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2c376ccb-ba5e-43c0-b524-f60354fc7b8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.277591 Aug 08 13:36:48.655776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 128/252] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:48 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:49.031951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-0f3c2a1b-c064-4a36-a871-ae6682576605 req-7bf1c390-f8d6-40fc-957a-6bffea793dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11502875-0366-4e45-876a-43cbc50f7261", "tag": "01423313-09fc-4ac2-a4ed-f147bfe4ee5c"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:49.037236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:49.046606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-0f3c2a1b-c064-4a36-a871-ae6682576605 req-7bf1c390-f8d6-40fc-957a-6bffea793dc4 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:49.047091 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-0f3c2a1b-c064-4a36-a871-ae6682576605 req-7bf1c390-f8d6-40fc-957a-6bffea793dc4 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:49.047527 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-0f3c2a1b-c064-4a36-a871-ae6682576605 req-7bf1c390-f8d6-40fc-957a-6bffea793dc4 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:49.057496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:49.060224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-0f3c2a1b-c064-4a36-a871-ae6682576605 req-7bf1c390-f8d6-40fc-957a-6bffea793dc4 service nova] Creating event network-changed:01423313-09fc-4ac2-a4ed-f147bfe4ee5c for instance 11502875-0366-4e45-876a-43cbc50f7261 on hv-cinder-85199 Aug 08 13:36:49.065582 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-0f3c2a1b-c064-4a36-a871-ae6682576605 req-7bf1c390-f8d6-40fc-957a-6bffea793dc4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037428 Aug 08 13:36:49.066192 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 125/253] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:49.142151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bd4e4a59-a29e-4f25-9fbe-d482fd015d8b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:49.142886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bd4e4a59-a29e-4f25-9fbe-d482fd015d8b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:49.149610 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd4e4a59-a29e-4f25-9fbe-d482fd015d8b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:49.149905 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd4e4a59-a29e-4f25-9fbe-d482fd015d8b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:49.150401 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd4e4a59-a29e-4f25-9fbe-d482fd015d8b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:49.151204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd4e4a59-a29e-4f25-9fbe-d482fd015d8b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:49.153608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd4e4a59-a29e-4f25-9fbe-d482fd015d8b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:49.153608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd4e4a59-a29e-4f25-9fbe-d482fd015d8b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:49.215007 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5ac1a9ed-db8e-4b81-847e-34eba9442542 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:49.215811 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5ac1a9ed-db8e-4b81-847e-34eba9442542 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:49.224529 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac1a9ed-db8e-4b81-847e-34eba9442542 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:49.225048 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac1a9ed-db8e-4b81-847e-34eba9442542 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:49.225494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac1a9ed-db8e-4b81-847e-34eba9442542 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:49.226219 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac1a9ed-db8e-4b81-847e-34eba9442542 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:49.226670 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac1a9ed-db8e-4b81-847e-34eba9442542 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:49.227113 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac1a9ed-db8e-4b81-847e-34eba9442542 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:49.332856 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bd4e4a59-a29e-4f25-9fbe-d482fd015d8b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:49.343612 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bd4e4a59-a29e-4f25-9fbe-d482fd015d8b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.205125 Aug 08 13:36:49.344227 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 129/254] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:49 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:49.417379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5ac1a9ed-db8e-4b81-847e-34eba9442542 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:49.426377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5ac1a9ed-db8e-4b81-847e-34eba9442542 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.216252 Aug 08 13:36:49.427004 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 126/255] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:49 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:49.631648 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-069db23d-983e-4f21-a586-ebfa4caedc20 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:49.632362 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-069db23d-983e-4f21-a586-ebfa4caedc20 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:49.634480 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:49.641148 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069db23d-983e-4f21-a586-ebfa4caedc20 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:49.641644 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069db23d-983e-4f21-a586-ebfa4caedc20 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:49.642155 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069db23d-983e-4f21-a586-ebfa4caedc20 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:49.642963 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069db23d-983e-4f21-a586-ebfa4caedc20 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:49.643516 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069db23d-983e-4f21-a586-ebfa4caedc20 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:49.644005 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069db23d-983e-4f21-a586-ebfa4caedc20 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:49.678153 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:49.681215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:49.687686 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:49.688180 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:49.688617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:49.689347 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:49.689799 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:49.690231 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:49.716100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-069db23d-983e-4f21-a586-ebfa4caedc20 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:49.728705 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-069db23d-983e-4f21-a586-ebfa4caedc20 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1282 microversion: 2.1 time: 0.100743 Aug 08 13:36:49.729319 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 130/256] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:49 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:49.875010 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:49.884205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:49.885930 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:49.887317 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-047da414-23cc-4158-86a4-627548acd211 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.213151 Aug 08 13:36:49.895263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 127/257] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:49 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:36:50.365244 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-41c89da2-a87f-474d-bc91-7a1ef24cfa0f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:50.365845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-41c89da2-a87f-474d-bc91-7a1ef24cfa0f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:50.372152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41c89da2-a87f-474d-bc91-7a1ef24cfa0f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:50.372638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41c89da2-a87f-474d-bc91-7a1ef24cfa0f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:50.373069 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41c89da2-a87f-474d-bc91-7a1ef24cfa0f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:50.373759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41c89da2-a87f-474d-bc91-7a1ef24cfa0f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:50.374208 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41c89da2-a87f-474d-bc91-7a1ef24cfa0f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:50.374632 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41c89da2-a87f-474d-bc91-7a1ef24cfa0f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:50.448418 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6f931ea9-656e-4c4a-85ec-140d0936693c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:50.449079 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6f931ea9-656e-4c4a-85ec-140d0936693c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:50.455337 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f931ea9-656e-4c4a-85ec-140d0936693c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:50.455694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f931ea9-656e-4c4a-85ec-140d0936693c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:50.456136 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f931ea9-656e-4c4a-85ec-140d0936693c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:50.456829 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f931ea9-656e-4c4a-85ec-140d0936693c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:50.457262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f931ea9-656e-4c4a-85ec-140d0936693c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:50.457669 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f931ea9-656e-4c4a-85ec-140d0936693c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:50.539869 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-41c89da2-a87f-474d-bc91-7a1ef24cfa0f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:50.547772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-41c89da2-a87f-474d-bc91-7a1ef24cfa0f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.186754 Aug 08 13:36:50.548359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 131/258] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:50 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:50.604293 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6f931ea9-656e-4c4a-85ec-140d0936693c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:50.614141 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6f931ea9-656e-4c4a-85ec-140d0936693c tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.169819 Aug 08 13:36:50.614722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 128/259] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:50 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:50.750181 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d67f3b8a-2da1-4b72-8ce8-861f0b1f0432 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:50.750796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d67f3b8a-2da1-4b72-8ce8-861f0b1f0432 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:50.757169 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d67f3b8a-2da1-4b72-8ce8-861f0b1f0432 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:50.757651 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d67f3b8a-2da1-4b72-8ce8-861f0b1f0432 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:50.758082 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d67f3b8a-2da1-4b72-8ce8-861f0b1f0432 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:50.758802 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d67f3b8a-2da1-4b72-8ce8-861f0b1f0432 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:50.759295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d67f3b8a-2da1-4b72-8ce8-861f0b1f0432 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:50.759716 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d67f3b8a-2da1-4b72-8ce8-861f0b1f0432 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:50.832219 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d67f3b8a-2da1-4b72-8ce8-861f0b1f0432 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:50.847169 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d67f3b8a-2da1-4b72-8ce8-861f0b1f0432 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1270 microversion: 2.1 time: 0.100659 Aug 08 13:36:50.847752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 132/260] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:50 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:50.911353 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:50.911977 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:50.918686 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:50.919188 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:50.919605 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:50.920292 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:50.920736 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:50.921181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:51.059726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:51.069097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:51.070592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:51.071759 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-56db95a8-85c1-46db-ac2e-1a58aa8a3f91 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.164686 Aug 08 13:36:51.072327 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 129/261] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:50 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:36:51.569754 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dc277386-d2bf-4e36-9de4-1a9f85352a3a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:51.570495 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-dc277386-d2bf-4e36-9de4-1a9f85352a3a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:51.577778 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc277386-d2bf-4e36-9de4-1a9f85352a3a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:51.578264 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc277386-d2bf-4e36-9de4-1a9f85352a3a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:51.578713 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc277386-d2bf-4e36-9de4-1a9f85352a3a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:51.579459 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc277386-d2bf-4e36-9de4-1a9f85352a3a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:51.579897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc277386-d2bf-4e36-9de4-1a9f85352a3a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:51.580318 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dc277386-d2bf-4e36-9de4-1a9f85352a3a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:51.638111 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3a716256-764b-42f7-ac2f-5695f7242eb3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:51.638792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3a716256-764b-42f7-ac2f-5695f7242eb3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:51.645879 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3a716256-764b-42f7-ac2f-5695f7242eb3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:51.646366 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3a716256-764b-42f7-ac2f-5695f7242eb3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:51.646790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3a716256-764b-42f7-ac2f-5695f7242eb3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:51.647507 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3a716256-764b-42f7-ac2f-5695f7242eb3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:51.648139 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3a716256-764b-42f7-ac2f-5695f7242eb3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:51.648561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3a716256-764b-42f7-ac2f-5695f7242eb3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:51.775377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-dc277386-d2bf-4e36-9de4-1a9f85352a3a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:51.786518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-dc277386-d2bf-4e36-9de4-1a9f85352a3a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.220669 Aug 08 13:36:51.801597 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 133/262] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:51 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:51.840258 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3a716256-764b-42f7-ac2f-5695f7242eb3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:51.848965 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3a716256-764b-42f7-ac2f-5695f7242eb3 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.215040 Aug 08 13:36:51.849540 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 130/263] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:51 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:51.875457 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-aeb5cc27-ac89-420c-a298-9a925626c560 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:51.876226 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-aeb5cc27-ac89-420c-a298-9a925626c560 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:51.882780 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-aeb5cc27-ac89-420c-a298-9a925626c560 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:51.883400 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-aeb5cc27-ac89-420c-a298-9a925626c560 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:51.883873 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-aeb5cc27-ac89-420c-a298-9a925626c560 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:51.884625 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-aeb5cc27-ac89-420c-a298-9a925626c560 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:51.885081 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-aeb5cc27-ac89-420c-a298-9a925626c560 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:51.885668 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-aeb5cc27-ac89-420c-a298-9a925626c560 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:51.958663 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-aeb5cc27-ac89-420c-a298-9a925626c560 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:51.966944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-aeb5cc27-ac89-420c-a298-9a925626c560 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1270 microversion: 2.1 time: 0.095779 Aug 08 13:36:51.967597 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 134/264] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:51 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:52.099263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:52.100663 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:52.112674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:52.112674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:52.113805 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:52.115186 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:52.115975 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:52.117208 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:52.297910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:52.309101 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:52.310665 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:52.311870 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b9bfbf5a-77c3-4ac8-a8cf-cd46af0f0cd7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.220675 Aug 08 13:36:52.312458 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 131/265] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:52 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:52.810609 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0673b09f-c4e1-4abc-b095-e2e09db0ad5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:52.811447 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0673b09f-c4e1-4abc-b095-e2e09db0ad5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:52.820405 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0673b09f-c4e1-4abc-b095-e2e09db0ad5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:52.821219 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0673b09f-c4e1-4abc-b095-e2e09db0ad5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:52.822240 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0673b09f-c4e1-4abc-b095-e2e09db0ad5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:52.823143 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0673b09f-c4e1-4abc-b095-e2e09db0ad5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:52.823613 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0673b09f-c4e1-4abc-b095-e2e09db0ad5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:52.824037 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0673b09f-c4e1-4abc-b095-e2e09db0ad5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:52.871527 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6f11f271-ac1b-4a0a-beec-af097cee2b91 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:52.872492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6f11f271-ac1b-4a0a-beec-af097cee2b91 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:52.879755 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f11f271-ac1b-4a0a-beec-af097cee2b91 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:52.880267 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f11f271-ac1b-4a0a-beec-af097cee2b91 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:52.880674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f11f271-ac1b-4a0a-beec-af097cee2b91 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:52.881516 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f11f271-ac1b-4a0a-beec-af097cee2b91 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:52.882042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f11f271-ac1b-4a0a-beec-af097cee2b91 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:52.882504 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f11f271-ac1b-4a0a-beec-af097cee2b91 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:53.099943 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0673b09f-c4e1-4abc-b095-e2e09db0ad5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:53.112745 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0673b09f-c4e1-4abc-b095-e2e09db0ad5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.305790 Aug 08 13:36:53.114367 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 135/266] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:52 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:53.123136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3b2f1b06-5350-4863-8e01-aecf27e14a37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:53.124233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3b2f1b06-5350-4863-8e01-aecf27e14a37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:53.136699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b06-5350-4863-8e01-aecf27e14a37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:53.137544 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b06-5350-4863-8e01-aecf27e14a37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:53.138556 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b06-5350-4863-8e01-aecf27e14a37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:53.139912 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b06-5350-4863-8e01-aecf27e14a37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:53.140921 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b06-5350-4863-8e01-aecf27e14a37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:53.142171 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b06-5350-4863-8e01-aecf27e14a37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:53.245070 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6f11f271-ac1b-4a0a-beec-af097cee2b91 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:53.255130 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6f11f271-ac1b-4a0a-beec-af097cee2b91 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.387569 Aug 08 13:36:53.256100 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 132/267] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:52 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:53.265860 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3b2f1b06-5350-4863-8e01-aecf27e14a37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:53.278139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3b2f1b06-5350-4863-8e01-aecf27e14a37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1270 microversion: 2.1 time: 0.162282 Aug 08 13:36:53.279499 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 136/268] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:53 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:53.338058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:53.338797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:53.348655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:53.349368 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:53.350035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:53.351306 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:53.352075 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:53.352631 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:53.626641 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:53.640840 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:53.642819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:53.644865 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a2ce917c-ff0d-4253-b711-3046f02ce164 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.311848 Aug 08 13:36:53.645520 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 133/269] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:53 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:54.140898 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-25de1a3d-b3a4-46df-8161-52fc1832442b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:54.141718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-25de1a3d-b3a4-46df-8161-52fc1832442b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:54.149424 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-25de1a3d-b3a4-46df-8161-52fc1832442b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:54.150809 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-25de1a3d-b3a4-46df-8161-52fc1832442b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:54.151419 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-25de1a3d-b3a4-46df-8161-52fc1832442b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:54.152157 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-25de1a3d-b3a4-46df-8161-52fc1832442b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:54.152608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-25de1a3d-b3a4-46df-8161-52fc1832442b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:54.153029 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-25de1a3d-b3a4-46df-8161-52fc1832442b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:54.289136 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-42662fe9-fd38-4643-a6b3-51b12f698558 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:54.290517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-42662fe9-fd38-4643-a6b3-51b12f698558 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:54.299336 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-42662fe9-fd38-4643-a6b3-51b12f698558 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:54.299778 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-42662fe9-fd38-4643-a6b3-51b12f698558 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:54.300633 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-42662fe9-fd38-4643-a6b3-51b12f698558 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:54.301072 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-42662fe9-fd38-4643-a6b3-51b12f698558 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:54.301567 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-42662fe9-fd38-4643-a6b3-51b12f698558 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:54.302059 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-42662fe9-fd38-4643-a6b3-51b12f698558 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:54.305534 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:54.343732 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-25de1a3d-b3a4-46df-8161-52fc1832442b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:54.353962 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-25de1a3d-b3a4-46df-8161-52fc1832442b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.217416 Aug 08 13:36:54.354807 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 137/270] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:54 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:54.364323 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-eb5f0ab7-b226-493b-b2ee-60c36e453f38 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:54.365467 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-eb5f0ab7-b226-493b-b2ee-60c36e453f38 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:54.385865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-eb5f0ab7-b226-493b-b2ee-60c36e453f38 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:54.386843 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-eb5f0ab7-b226-493b-b2ee-60c36e453f38 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:54.387885 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-eb5f0ab7-b226-493b-b2ee-60c36e453f38 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:54.389098 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-eb5f0ab7-b226-493b-b2ee-60c36e453f38 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:54.390139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-eb5f0ab7-b226-493b-b2ee-60c36e453f38 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:54.390859 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-eb5f0ab7-b226-493b-b2ee-60c36e453f38 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:54.503617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-42662fe9-fd38-4643-a6b3-51b12f698558 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:54.513320 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-42662fe9-fd38-4643-a6b3-51b12f698558 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.228078 Aug 08 13:36:54.513906 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 134/271] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:54 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:54.613002 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-eb5f0ab7-b226-493b-b2ee-60c36e453f38 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:54.627418 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-eb5f0ab7-b226-493b-b2ee-60c36e453f38 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.270461 Aug 08 13:36:54.628533 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 138/272] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:54 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:54.668973 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:54.669588 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:54.675948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:54.676418 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:54.676840 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:54.677538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:54.677983 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:54.678424 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:54.825624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:54.834416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:54.836041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:54.837179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f8bf6980-d93f-4b4c-8b57-a11f5a4af14e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.172422 Aug 08 13:36:54.837783 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 135/273] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:54 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:55.387309 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fde32871-4ef8-48cd-b99c-31731d869bec tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:55.388132 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fde32871-4ef8-48cd-b99c-31731d869bec tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:55.395042 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fde32871-4ef8-48cd-b99c-31731d869bec tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:55.395587 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fde32871-4ef8-48cd-b99c-31731d869bec tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:55.396029 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fde32871-4ef8-48cd-b99c-31731d869bec tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:55.396796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fde32871-4ef8-48cd-b99c-31731d869bec tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:55.397255 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fde32871-4ef8-48cd-b99c-31731d869bec tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:55.397682 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fde32871-4ef8-48cd-b99c-31731d869bec tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:55.534742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-60c4d2e7-0fa7-497b-97cc-0e47865fb398 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:55.535656 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-60c4d2e7-0fa7-497b-97cc-0e47865fb398 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:55.543846 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60c4d2e7-0fa7-497b-97cc-0e47865fb398 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:55.544579 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60c4d2e7-0fa7-497b-97cc-0e47865fb398 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:55.545113 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60c4d2e7-0fa7-497b-97cc-0e47865fb398 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:55.546102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60c4d2e7-0fa7-497b-97cc-0e47865fb398 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:55.546565 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60c4d2e7-0fa7-497b-97cc-0e47865fb398 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:55.547243 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60c4d2e7-0fa7-497b-97cc-0e47865fb398 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:55.549314 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fde32871-4ef8-48cd-b99c-31731d869bec tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:55.558776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fde32871-4ef8-48cd-b99c-31731d869bec tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.175726 Aug 08 13:36:55.559589 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 139/274] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:55 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:55.665124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bbc20d06-b0eb-4331-b12c-2ad6b6a7811f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:55.665977 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bbc20d06-b0eb-4331-b12c-2ad6b6a7811f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:55.675007 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bbc20d06-b0eb-4331-b12c-2ad6b6a7811f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:55.675806 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bbc20d06-b0eb-4331-b12c-2ad6b6a7811f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:55.676369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bbc20d06-b0eb-4331-b12c-2ad6b6a7811f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:55.677281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bbc20d06-b0eb-4331-b12c-2ad6b6a7811f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:55.677890 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bbc20d06-b0eb-4331-b12c-2ad6b6a7811f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:55.678530 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bbc20d06-b0eb-4331-b12c-2ad6b6a7811f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:55.744859 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-60c4d2e7-0fa7-497b-97cc-0e47865fb398 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:55.759896 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-60c4d2e7-0fa7-497b-97cc-0e47865fb398 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.228762 Aug 08 13:36:55.760955 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 136/275] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:55 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:55.834883 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bbc20d06-b0eb-4331-b12c-2ad6b6a7811f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:55.843403 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bbc20d06-b0eb-4331-b12c-2ad6b6a7811f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.183527 Aug 08 13:36:55.844004 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 140/276] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:55 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:55.866655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:55.867576 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:55.876590 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:55.877281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:55.877832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:55.878867 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:55.879591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:55.880271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:56.053935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:56.068619 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:56.071534 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:56.073637 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-60953842-80f4-4a7d-9b08-d32a7e27c7d6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.214444 Aug 08 13:36:56.074655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 137/277] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:55 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:56.582107 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b01194ad-697d-4f9b-89fc-3fe250cfc959 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:56.582699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b01194ad-697d-4f9b-89fc-3fe250cfc959 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:56.589148 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b01194ad-697d-4f9b-89fc-3fe250cfc959 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:56.589648 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b01194ad-697d-4f9b-89fc-3fe250cfc959 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:56.590083 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b01194ad-697d-4f9b-89fc-3fe250cfc959 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:56.590793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b01194ad-697d-4f9b-89fc-3fe250cfc959 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:56.591505 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b01194ad-697d-4f9b-89fc-3fe250cfc959 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:56.591927 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b01194ad-697d-4f9b-89fc-3fe250cfc959 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:56.732470 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b01194ad-697d-4f9b-89fc-3fe250cfc959 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:56.742957 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b01194ad-697d-4f9b-89fc-3fe250cfc959 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.165076 Aug 08 13:36:56.749022 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 141/278] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:56 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:56.796593 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-dc4285ec-e5fd-40ba-ac92-67acb12a16a9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:56.797561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-dc4285ec-e5fd-40ba-ac92-67acb12a16a9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:56.806024 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dc4285ec-e5fd-40ba-ac92-67acb12a16a9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:56.806519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dc4285ec-e5fd-40ba-ac92-67acb12a16a9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:56.806946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dc4285ec-e5fd-40ba-ac92-67acb12a16a9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:56.807678 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dc4285ec-e5fd-40ba-ac92-67acb12a16a9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:56.808109 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dc4285ec-e5fd-40ba-ac92-67acb12a16a9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:56.808525 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dc4285ec-e5fd-40ba-ac92-67acb12a16a9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:56.865511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-39080ac9-888a-4cb5-9f57-1e2da2eb68d8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:56.866053 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-39080ac9-888a-4cb5-9f57-1e2da2eb68d8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:56.872802 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-39080ac9-888a-4cb5-9f57-1e2da2eb68d8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:56.873348 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-39080ac9-888a-4cb5-9f57-1e2da2eb68d8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:56.873775 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-39080ac9-888a-4cb5-9f57-1e2da2eb68d8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:56.874571 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-39080ac9-888a-4cb5-9f57-1e2da2eb68d8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:56.875017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-39080ac9-888a-4cb5-9f57-1e2da2eb68d8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:56.875583 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-39080ac9-888a-4cb5-9f57-1e2da2eb68d8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:56.994658 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dc4285ec-e5fd-40ba-ac92-67acb12a16a9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:57.004038 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-dc4285ec-e5fd-40ba-ac92-67acb12a16a9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.213439 Aug 08 13:36:57.004853 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 138/279] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:56 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:57.039738 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-39080ac9-888a-4cb5-9f57-1e2da2eb68d8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:57.049033 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-39080ac9-888a-4cb5-9f57-1e2da2eb68d8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.187804 Aug 08 13:36:57.049658 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 142/280] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:56 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:57.097141 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:57.097874 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:57.105295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:57.105805 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:57.106230 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:57.106951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:57.107448 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:57.107874 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:57.266882 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:57.278685 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:57.280535 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:57.281714 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ac4b6d55-afe1-4228-9c40-956c957abb76 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.188657 Aug 08 13:36:57.282294 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 139/281] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:57 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:57.763905 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-503fc257-b5db-4dfd-b7e6-fe749e6bc895 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:57.764653 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-503fc257-b5db-4dfd-b7e6-fe749e6bc895 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:57.771202 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503fc257-b5db-4dfd-b7e6-fe749e6bc895 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:57.771752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503fc257-b5db-4dfd-b7e6-fe749e6bc895 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:57.772184 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503fc257-b5db-4dfd-b7e6-fe749e6bc895 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:57.772901 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503fc257-b5db-4dfd-b7e6-fe749e6bc895 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:57.773348 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503fc257-b5db-4dfd-b7e6-fe749e6bc895 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:57.773771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503fc257-b5db-4dfd-b7e6-fe749e6bc895 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:57.777254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:57.932905 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-503fc257-b5db-4dfd-b7e6-fe749e6bc895 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:57.941159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-503fc257-b5db-4dfd-b7e6-fe749e6bc895 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.181814 Aug 08 13:36:57.941765 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 143/282] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:57 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:58.025396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6477e17a-339c-44b1-9d75-3c523e2fd7f0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:58.026027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6477e17a-339c-44b1-9d75-3c523e2fd7f0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:58.033535 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6477e17a-339c-44b1-9d75-3c523e2fd7f0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:58.034027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6477e17a-339c-44b1-9d75-3c523e2fd7f0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:58.034455 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6477e17a-339c-44b1-9d75-3c523e2fd7f0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:58.035205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6477e17a-339c-44b1-9d75-3c523e2fd7f0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:58.035729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6477e17a-339c-44b1-9d75-3c523e2fd7f0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:58.036150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6477e17a-339c-44b1-9d75-3c523e2fd7f0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:58.070161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ca5ac8af-de27-481a-9782-4db1d1882a3f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:58.070889 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ca5ac8af-de27-481a-9782-4db1d1882a3f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:58.077820 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca5ac8af-de27-481a-9782-4db1d1882a3f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:58.078436 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca5ac8af-de27-481a-9782-4db1d1882a3f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:58.079043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca5ac8af-de27-481a-9782-4db1d1882a3f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:58.079838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca5ac8af-de27-481a-9782-4db1d1882a3f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:58.080301 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca5ac8af-de27-481a-9782-4db1d1882a3f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:58.080703 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca5ac8af-de27-481a-9782-4db1d1882a3f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:58.234536 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6477e17a-339c-44b1-9d75-3c523e2fd7f0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:58.245519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6477e17a-339c-44b1-9d75-3c523e2fd7f0 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.223790 Aug 08 13:36:58.246606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 140/283] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:58 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:58.267844 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ca5ac8af-de27-481a-9782-4db1d1882a3f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:58.276426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ca5ac8af-de27-481a-9782-4db1d1882a3f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.209933 Aug 08 13:36:58.276932 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 144/284] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:58 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:58.307541 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:58.308311 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:58.319727 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:58.320559 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:58.321296 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:58.322941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:58.323459 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:58.324179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:58.724692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:58.736383 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:58.739845 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:58.741689 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e4c8b0b5-e707-438e-8e02-1bd1f28df9de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.439303 Aug 08 13:36:58.742351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 141/285] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:58 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:36:58.963644 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4df081f0-28cd-4bd6-95d0-f86b4ada99b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:58.964260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4df081f0-28cd-4bd6-95d0-f86b4ada99b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:58.972488 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4df081f0-28cd-4bd6-95d0-f86b4ada99b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:58.973352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4df081f0-28cd-4bd6-95d0-f86b4ada99b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:58.973765 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4df081f0-28cd-4bd6-95d0-f86b4ada99b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:58.974495 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4df081f0-28cd-4bd6-95d0-f86b4ada99b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:58.974944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4df081f0-28cd-4bd6-95d0-f86b4ada99b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:58.975546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4df081f0-28cd-4bd6-95d0-f86b4ada99b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:59.253746 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4df081f0-28cd-4bd6-95d0-f86b4ada99b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:59.267672 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4df081f0-28cd-4bd6-95d0-f86b4ada99b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.307911 Aug 08 13:36:59.269421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 145/286] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:58 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:59.287421 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-066530c8-21d2-4865-9047-67d24f2cf3a8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:59.291866 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-066530c8-21d2-4865-9047-67d24f2cf3a8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:59.300362 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5bac634e-745d-485b-82c1-d419b06d74f2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:59.301614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-5bac634e-745d-485b-82c1-d419b06d74f2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:59.314302 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bac634e-745d-485b-82c1-d419b06d74f2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:59.315749 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bac634e-745d-485b-82c1-d419b06d74f2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:59.317435 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-066530c8-21d2-4865-9047-67d24f2cf3a8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:59.318494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bac634e-745d-485b-82c1-d419b06d74f2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:59.320940 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bac634e-745d-485b-82c1-d419b06d74f2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:59.321370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-066530c8-21d2-4865-9047-67d24f2cf3a8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:59.322900 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-066530c8-21d2-4865-9047-67d24f2cf3a8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:59.324232 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bac634e-745d-485b-82c1-d419b06d74f2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:59.325039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5bac634e-745d-485b-82c1-d419b06d74f2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:59.327964 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-066530c8-21d2-4865-9047-67d24f2cf3a8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:59.329243 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-066530c8-21d2-4865-9047-67d24f2cf3a8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:59.332610 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-066530c8-21d2-4865-9047-67d24f2cf3a8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:59.686283 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-5bac634e-745d-485b-82c1-d419b06d74f2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:59.703431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-5bac634e-745d-485b-82c1-d419b06d74f2 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.409121 Aug 08 13:36:59.704206 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 146/287] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:59 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:36:59.715617 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-06a7925e-c170-489d-a83f-a31f49950a51 req-e06ac7c9-5c51-4133-8222-00d5c9f1db1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e499da8-c64b-4053-b226-81dd1ca2cbee", "tag": "81eb53f9-0c92-420c-b3a2-7e1f0d216283"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:59.720972 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:36:59.737896 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-066530c8-21d2-4865-9047-67d24f2cf3a8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:36:59.766894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-06a7925e-c170-489d-a83f-a31f49950a51 req-e06ac7c9-5c51-4133-8222-00d5c9f1db1b service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:59.768588 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-06a7925e-c170-489d-a83f-a31f49950a51 req-e06ac7c9-5c51-4133-8222-00d5c9f1db1b service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:59.771317 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-066530c8-21d2-4865-9047-67d24f2cf3a8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1554 microversion: 2.1 time: 0.493165 Aug 08 13:36:59.772566 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-06a7925e-c170-489d-a83f-a31f49950a51 req-e06ac7c9-5c51-4133-8222-00d5c9f1db1b service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:59.773291 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 142/288] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:36:59 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1554 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:36:59.783591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:36:59.786909 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:36:59.802843 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:59.807260 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:59.809094 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:59.812341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:59.813930 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:59.821155 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:59.844222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-06a7925e-c170-489d-a83f-a31f49950a51 req-e06ac7c9-5c51-4133-8222-00d5c9f1db1b service nova] Creating event network-changed:81eb53f9-0c92-420c-b3a2-7e1f0d216283 for instance 0e499da8-c64b-4053-b226-81dd1ca2cbee on hv-cinder-85199 Aug 08 13:36:59.859433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-06a7925e-c170-489d-a83f-a31f49950a51 req-e06ac7c9-5c51-4133-8222-00d5c9f1db1b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153536 Aug 08 13:36:59.863640 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 147/289] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:36:59.876663 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-0afe9209-50b6-40d7-8859-8f8bc7a49ab7 req-b3cb17b1-fb0a-4669-8d40-e5636206c04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488cdad7-8bac-4f8a-b412-851f6f2486a3", "name": "network-vif-deleted", "tag": "9eb1a549-51fa-449c-98c1-c9211fba91ec"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:36:59.901129 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-0afe9209-50b6-40d7-8859-8f8bc7a49ab7 req-b3cb17b1-fb0a-4669-8d40-e5636206c04d service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:36:59.902320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-0afe9209-50b6-40d7-8859-8f8bc7a49ab7 req-b3cb17b1-fb0a-4669-8d40-e5636206c04d service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:36:59.903947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-0afe9209-50b6-40d7-8859-8f8bc7a49ab7 req-b3cb17b1-fb0a-4669-8d40-e5636206c04d service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:36:59.928487 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-0afe9209-50b6-40d7-8859-8f8bc7a49ab7 req-b3cb17b1-fb0a-4669-8d40-e5636206c04d service nova] Creating event network-vif-deleted:9eb1a549-51fa-449c-98c1-c9211fba91ec for instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 on hv-cinder-85199 Aug 08 13:36:59.943816 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-0afe9209-50b6-40d7-8859-8f8bc7a49ab7 req-b3cb17b1-fb0a-4669-8d40-e5636206c04d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076349 Aug 08 13:36:59.944140 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 148/290] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:37:00.029036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:00.038705 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:00.040789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:00.042392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8ddf7cff-3957-4455-8c2c-a95d0912e442 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.267203 Aug 08 13:37:00.043275 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 143/291] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:36:59 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:37:00.292080 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6f780e8b-08d8-4330-ae95-98706eee3e8d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:00.292913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6f780e8b-08d8-4330-ae95-98706eee3e8d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:00.300212 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6f780e8b-08d8-4330-ae95-98706eee3e8d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:00.300800 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6f780e8b-08d8-4330-ae95-98706eee3e8d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:00.301295 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6f780e8b-08d8-4330-ae95-98706eee3e8d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:00.302084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6f780e8b-08d8-4330-ae95-98706eee3e8d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:00.302806 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6f780e8b-08d8-4330-ae95-98706eee3e8d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:00.303371 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6f780e8b-08d8-4330-ae95-98706eee3e8d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:00.457290 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6f780e8b-08d8-4330-ae95-98706eee3e8d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:00.471265 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6f780e8b-08d8-4330-ae95-98706eee3e8d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.183457 Aug 08 13:37:00.472628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 149/292] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:00 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:00.740895 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ed5c2e7f-dc5a-4e78-ac20-73b05cf301b4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:00.741738 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ed5c2e7f-dc5a-4e78-ac20-73b05cf301b4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:00.748571 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ed5c2e7f-dc5a-4e78-ac20-73b05cf301b4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:00.749067 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ed5c2e7f-dc5a-4e78-ac20-73b05cf301b4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:00.749492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ed5c2e7f-dc5a-4e78-ac20-73b05cf301b4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:00.750210 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ed5c2e7f-dc5a-4e78-ac20-73b05cf301b4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:00.750781 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ed5c2e7f-dc5a-4e78-ac20-73b05cf301b4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:00.751232 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ed5c2e7f-dc5a-4e78-ac20-73b05cf301b4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:00.818752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6d99c657-517b-4878-ae43-26818f191080 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:00.819914 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6d99c657-517b-4878-ae43-26818f191080 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:00.829016 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d99c657-517b-4878-ae43-26818f191080 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:00.829604 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d99c657-517b-4878-ae43-26818f191080 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:00.830117 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d99c657-517b-4878-ae43-26818f191080 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:00.831163 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d99c657-517b-4878-ae43-26818f191080 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:00.831605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d99c657-517b-4878-ae43-26818f191080 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:00.832014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d99c657-517b-4878-ae43-26818f191080 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:00.923643 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6d99c657-517b-4878-ae43-26818f191080 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:00.935641 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6d99c657-517b-4878-ae43-26818f191080 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1345 microversion: 2.1 time: 0.123006 Aug 08 13:37:00.936716 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 150/293] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:00 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:00.946227 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ed5c2e7f-dc5a-4e78-ac20-73b05cf301b4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:00.962187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ed5c2e7f-dc5a-4e78-ac20-73b05cf301b4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.225220 Aug 08 13:37:00.963989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 144/294] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:00 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:01.080157 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:01.081303 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:01.089971 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:01.090653 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:01.091188 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:01.092067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:01.092691 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:01.093203 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:01.327150 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:01.338038 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:01.341526 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:01.342346 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-96dc40b1-2abe-4bf5-b9b6-b2cf88340c39 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.267379 Aug 08 13:37:01.343364 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 151/295] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:37:01 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:37:01.507010 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-27877b81-912e-48f3-9c48-304840ec92cd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:01.507751 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-27877b81-912e-48f3-9c48-304840ec92cd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:01.517635 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27877b81-912e-48f3-9c48-304840ec92cd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:01.517635 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27877b81-912e-48f3-9c48-304840ec92cd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:01.517635 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27877b81-912e-48f3-9c48-304840ec92cd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:01.517635 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27877b81-912e-48f3-9c48-304840ec92cd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:01.518167 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27877b81-912e-48f3-9c48-304840ec92cd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:01.518167 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27877b81-912e-48f3-9c48-304840ec92cd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:01.694419 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-27877b81-912e-48f3-9c48-304840ec92cd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:01.707618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-27877b81-912e-48f3-9c48-304840ec92cd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.204710 Aug 08 13:37:01.708370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 145/296] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:01 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:01.981454 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7c3b3559-7bad-4b59-85ba-d35e24828d60 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:01.982110 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7c3b3559-7bad-4b59-85ba-d35e24828d60 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:01.988984 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0610f93c-307f-44d5-bdc6-122d3316fe4c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:01.991321 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0610f93c-307f-44d5-bdc6-122d3316fe4c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:01.991522 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7c3b3559-7bad-4b59-85ba-d35e24828d60 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:01.992337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7c3b3559-7bad-4b59-85ba-d35e24828d60 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:01.993446 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7c3b3559-7bad-4b59-85ba-d35e24828d60 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:01.994621 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7c3b3559-7bad-4b59-85ba-d35e24828d60 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:01.995811 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7c3b3559-7bad-4b59-85ba-d35e24828d60 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:01.996751 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7c3b3559-7bad-4b59-85ba-d35e24828d60 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:02.003114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610f93c-307f-44d5-bdc6-122d3316fe4c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:02.004380 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610f93c-307f-44d5-bdc6-122d3316fe4c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:02.005043 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610f93c-307f-44d5-bdc6-122d3316fe4c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:02.006119 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610f93c-307f-44d5-bdc6-122d3316fe4c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:02.007014 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610f93c-307f-44d5-bdc6-122d3316fe4c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:02.007809 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610f93c-307f-44d5-bdc6-122d3316fe4c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:02.120415 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7c3b3559-7bad-4b59-85ba-d35e24828d60 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:02.136272 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7c3b3559-7bad-4b59-85ba-d35e24828d60 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1345 microversion: 2.1 time: 0.159760 Aug 08 13:37:02.151402 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 152/297] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:01 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:02.235115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0610f93c-307f-44d5-bdc6-122d3316fe4c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:02.244023 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0610f93c-307f-44d5-bdc6-122d3316fe4c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.262011 Aug 08 13:37:02.244633 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 146/298] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:01 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:02.370415 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:02.371554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:02.386219 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:02.387249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:02.388062 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:02.389370 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:02.390183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:02.391001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:02.578909 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:02.592375 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:02.595580 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:02.597257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d3f832dc-496b-4e2c-8c43-bcc2c1500db0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.231925 Aug 08 13:37:02.597951 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 153/299] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:37:02 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:37:02.743452 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b8c420f3-eb16-4322-87e5-6b338bdc9254 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:02.744088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b8c420f3-eb16-4322-87e5-6b338bdc9254 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:02.752013 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b8c420f3-eb16-4322-87e5-6b338bdc9254 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:02.752624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b8c420f3-eb16-4322-87e5-6b338bdc9254 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:02.753157 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b8c420f3-eb16-4322-87e5-6b338bdc9254 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:02.753998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b8c420f3-eb16-4322-87e5-6b338bdc9254 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:02.754541 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b8c420f3-eb16-4322-87e5-6b338bdc9254 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:02.755046 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b8c420f3-eb16-4322-87e5-6b338bdc9254 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:03.028597 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b8c420f3-eb16-4322-87e5-6b338bdc9254 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:03.040763 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b8c420f3-eb16-4322-87e5-6b338bdc9254 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.304934 Aug 08 13:37:03.042374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 147/300] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:02 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:03.173838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2aa31667-cf51-4f09-9c89-6a770509f8bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:03.174450 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2aa31667-cf51-4f09-9c89-6a770509f8bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:03.181101 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2aa31667-cf51-4f09-9c89-6a770509f8bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:03.181591 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2aa31667-cf51-4f09-9c89-6a770509f8bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:03.182019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2aa31667-cf51-4f09-9c89-6a770509f8bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:03.182726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2aa31667-cf51-4f09-9c89-6a770509f8bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:03.183209 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2aa31667-cf51-4f09-9c89-6a770509f8bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:03.183633 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2aa31667-cf51-4f09-9c89-6a770509f8bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:03.280745 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9856804e-ceff-41f7-a4df-8247bafc3a7d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:03.281067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2aa31667-cf51-4f09-9c89-6a770509f8bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:03.281729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9856804e-ceff-41f7-a4df-8247bafc3a7d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:03.290615 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9856804e-ceff-41f7-a4df-8247bafc3a7d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:03.291421 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9856804e-ceff-41f7-a4df-8247bafc3a7d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:03.291605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2aa31667-cf51-4f09-9c89-6a770509f8bd tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1345 microversion: 2.1 time: 0.121606 Aug 08 13:37:03.292010 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9856804e-ceff-41f7-a4df-8247bafc3a7d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:03.293102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9856804e-ceff-41f7-a4df-8247bafc3a7d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:03.293932 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9856804e-ceff-41f7-a4df-8247bafc3a7d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:03.294657 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9856804e-ceff-41f7-a4df-8247bafc3a7d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:03.305015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 154/301] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:03 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:03.449331 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9856804e-ceff-41f7-a4df-8247bafc3a7d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:03.458686 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9856804e-ceff-41f7-a4df-8247bafc3a7d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.185034 Aug 08 13:37:03.459443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 148/302] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:03 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:03.622100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:03.622713 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:03.629608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:03.630275 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:03.630712 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:03.631455 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:03.631906 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:03.632327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:03.804339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:03.812957 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:03.814462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:03.815629 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-74667652-30df-40c9-aa4f-89a47bbe6693 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.197577 Aug 08 13:37:03.816182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 155/303] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:37:03 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:37:04.069754 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-02a1414f-7b3c-4a6c-8cb5-3a893412d920 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:04.070501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-02a1414f-7b3c-4a6c-8cb5-3a893412d920 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:04.078088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02a1414f-7b3c-4a6c-8cb5-3a893412d920 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:04.078661 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02a1414f-7b3c-4a6c-8cb5-3a893412d920 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:04.079267 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02a1414f-7b3c-4a6c-8cb5-3a893412d920 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:04.079911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02a1414f-7b3c-4a6c-8cb5-3a893412d920 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:04.080369 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02a1414f-7b3c-4a6c-8cb5-3a893412d920 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:04.080793 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02a1414f-7b3c-4a6c-8cb5-3a893412d920 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:04.229806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-02a1414f-7b3c-4a6c-8cb5-3a893412d920 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:04.243336 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-02a1414f-7b3c-4a6c-8cb5-3a893412d920 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.177402 Aug 08 13:37:04.244379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 149/304] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:04 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:04.317407 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-943952fc-d400-4295-a69b-b2ecbc708786 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:04.318313 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-943952fc-d400-4295-a69b-b2ecbc708786 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:04.330727 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-943952fc-d400-4295-a69b-b2ecbc708786 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:04.331631 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-943952fc-d400-4295-a69b-b2ecbc708786 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:04.332882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-943952fc-d400-4295-a69b-b2ecbc708786 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:04.333676 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-943952fc-d400-4295-a69b-b2ecbc708786 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:04.334660 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-943952fc-d400-4295-a69b-b2ecbc708786 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:04.335346 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-943952fc-d400-4295-a69b-b2ecbc708786 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:04.455334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-943952fc-d400-4295-a69b-b2ecbc708786 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:04.466405 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-943952fc-d400-4295-a69b-b2ecbc708786 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1345 microversion: 2.1 time: 0.155714 Aug 08 13:37:04.467537 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 156/305] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:04 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1345 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:04.486123 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a0add247-57fa-421e-a990-5a912e089287 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:04.487300 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a0add247-57fa-421e-a990-5a912e089287 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:04.498189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0add247-57fa-421e-a990-5a912e089287 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:04.498883 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0add247-57fa-421e-a990-5a912e089287 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:04.499493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0add247-57fa-421e-a990-5a912e089287 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:04.500388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0add247-57fa-421e-a990-5a912e089287 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:04.501045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0add247-57fa-421e-a990-5a912e089287 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:04.501715 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0add247-57fa-421e-a990-5a912e089287 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:04.675273 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a0add247-57fa-421e-a990-5a912e089287 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:04.677591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=100 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:04.684904 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a0add247-57fa-421e-a990-5a912e089287 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.207015 Aug 08 13:37:04.685503 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 150/306] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:04 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:04.838625 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:04.839238 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:04.845827 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:04.846311 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:04.846733 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:04.847476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:04.847917 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:04.848301 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:04.986560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:04.995493 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:04.996979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:04.998097 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0afdd30c-a77b-473d-9c55-4f06a9b729fc tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1405 microversion: 2.20 time: 0.163610 Aug 08 13:37:04.998784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 157/307] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:37:04 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:37:05.265110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5e1aba03-dbd5-45b8-bc8f-0e1d92644b4a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:05.265773 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5e1aba03-dbd5-45b8-bc8f-0e1d92644b4a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:05.273027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e1aba03-dbd5-45b8-bc8f-0e1d92644b4a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:05.273518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e1aba03-dbd5-45b8-bc8f-0e1d92644b4a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:05.273945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e1aba03-dbd5-45b8-bc8f-0e1d92644b4a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:05.274682 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e1aba03-dbd5-45b8-bc8f-0e1d92644b4a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:05.275157 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e1aba03-dbd5-45b8-bc8f-0e1d92644b4a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:05.275573 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e1aba03-dbd5-45b8-bc8f-0e1d92644b4a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:05.471064 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5e1aba03-dbd5-45b8-bc8f-0e1d92644b4a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:05.492897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-495f8e4a-0e9b-4e17-8f7b-5dfca13f6b3f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:05.494297 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5e1aba03-dbd5-45b8-bc8f-0e1d92644b4a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.232668 Aug 08 13:37:05.494621 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-495f8e4a-0e9b-4e17-8f7b-5dfca13f6b3f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:05.501989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 151/308] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:05 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:05.506480 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-495f8e4a-0e9b-4e17-8f7b-5dfca13f6b3f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:05.507640 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-495f8e4a-0e9b-4e17-8f7b-5dfca13f6b3f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:05.508428 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-495f8e4a-0e9b-4e17-8f7b-5dfca13f6b3f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:05.509703 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-495f8e4a-0e9b-4e17-8f7b-5dfca13f6b3f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:05.510616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-495f8e4a-0e9b-4e17-8f7b-5dfca13f6b3f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:05.511416 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-495f8e4a-0e9b-4e17-8f7b-5dfca13f6b3f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:05.595263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-495f8e4a-0e9b-4e17-8f7b-5dfca13f6b3f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:05.608659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-495f8e4a-0e9b-4e17-8f7b-5dfca13f6b3f tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1345 microversion: 2.1 time: 0.122843 Aug 08 13:37:05.610029 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 158/309] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:05 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:05.716666 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-83dac51d-3b4c-4ad2-8f7d-899c8093fe4a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:05.718185 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-83dac51d-3b4c-4ad2-8f7d-899c8093fe4a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:05.729875 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83dac51d-3b4c-4ad2-8f7d-899c8093fe4a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:05.731021 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83dac51d-3b4c-4ad2-8f7d-899c8093fe4a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:05.731895 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83dac51d-3b4c-4ad2-8f7d-899c8093fe4a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:05.733258 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83dac51d-3b4c-4ad2-8f7d-899c8093fe4a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:05.734212 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83dac51d-3b4c-4ad2-8f7d-899c8093fe4a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:05.735117 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83dac51d-3b4c-4ad2-8f7d-899c8093fe4a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:05.948742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-83dac51d-3b4c-4ad2-8f7d-899c8093fe4a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:05.962723 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-83dac51d-3b4c-4ad2-8f7d-899c8093fe4a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.253152 Aug 08 13:37:05.963769 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 152/310] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:05 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:06.021413 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:06.022297 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:06.029501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:06.030161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:06.030720 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:06.031768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:06.032373 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:06.032894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:06.210056 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:06.220911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:06.222728 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:06.224439 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9da629e6-595c-4f90-9893-de93917433cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1598 microversion: 2.20 time: 0.207023 Aug 08 13:37:06.225657 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 159/311] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:37:06 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1598 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:37:06.249380 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-065127e2-347c-40dd-87c3-aecb10ace88e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:06.250225 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-065127e2-347c-40dd-87c3-aecb10ace88e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:06.257018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065127e2-347c-40dd-87c3-aecb10ace88e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:06.257516 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065127e2-347c-40dd-87c3-aecb10ace88e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:06.257942 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065127e2-347c-40dd-87c3-aecb10ace88e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:06.258838 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065127e2-347c-40dd-87c3-aecb10ace88e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:06.259333 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065127e2-347c-40dd-87c3-aecb10ace88e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:06.259759 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065127e2-347c-40dd-87c3-aecb10ace88e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:06.351645 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-065127e2-347c-40dd-87c3-aecb10ace88e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106229 Aug 08 13:37:06.352747 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 153/312] 10.222.0.33 () {60 vars in 1316 bytes} [Mon Aug 8 13:37:06 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:37:06.529162 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-13b82a8e-52e2-4bb5-957b-8b15b8f33f50 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:06.530032 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-13b82a8e-52e2-4bb5-957b-8b15b8f33f50 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:06.537551 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13b82a8e-52e2-4bb5-957b-8b15b8f33f50 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:06.538067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13b82a8e-52e2-4bb5-957b-8b15b8f33f50 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:06.538505 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13b82a8e-52e2-4bb5-957b-8b15b8f33f50 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:06.539322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13b82a8e-52e2-4bb5-957b-8b15b8f33f50 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:06.539734 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13b82a8e-52e2-4bb5-957b-8b15b8f33f50 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:06.540170 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-13b82a8e-52e2-4bb5-957b-8b15b8f33f50 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:06.675041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:06.675041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:06.690871 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:06.692082 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:06.693054 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:06.695810 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:06.697666 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:06.699265 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:06.794363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:06.795395 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:06.796757 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:06.798195 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.objects.instance [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lazy-loading 'fault' on Instance uuid 488cdad7-8bac-4f8a-b412-851f6f2486a3 {{(pid=124407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:37:06.931557 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93191a5e3c7476f926b56424ccec4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5021d13535274fa2b44666c8d39080bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:06.951490 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3cd31c66-ddd8-4bc6-8320-f21b0a2106e8 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 200 len: 1350 microversion: 2.1 time: 0.301398 Aug 08 13:37:06.953144 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 154/313] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:06 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 1350 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:06.995357 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0e0a73fd-d423-4cbe-8806-56578a7a6c7f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:06.995992 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0e0a73fd-d423-4cbe-8806-56578a7a6c7f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:07.017338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-13b82a8e-52e2-4bb5-957b-8b15b8f33f50 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:07.020289 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e0a73fd-d423-4cbe-8806-56578a7a6c7f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:07.024108 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e0a73fd-d423-4cbe-8806-56578a7a6c7f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:07.024414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e0a73fd-d423-4cbe-8806-56578a7a6c7f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:07.026040 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e0a73fd-d423-4cbe-8806-56578a7a6c7f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:07.027068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e0a73fd-d423-4cbe-8806-56578a7a6c7f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:07.027634 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0e0a73fd-d423-4cbe-8806-56578a7a6c7f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:07.048027 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-13b82a8e-52e2-4bb5-957b-8b15b8f33f50 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.523179 Aug 08 13:37:07.049235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 160/314] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:06 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:07.417423 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0e0a73fd-d423-4cbe-8806-56578a7a6c7f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:07.430853 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0e0a73fd-d423-4cbe-8806-56578a7a6c7f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.439232 Aug 08 13:37:07.432289 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 155/315] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:06 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:07.985360 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:07.987171 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:07.998921 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:08.000289 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:08.001318 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:08.003247 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:08.004672 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:08.005448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:08.026427 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:08.027781 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] HTTP exception thrown: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Request method failure captured: Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 HTTP/1.1 Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REVldU13qQtwTEYs2pKBJTyJDSJmkq-KnhBjp-qo1-LgPHR6c3x4UQtnhA_UHp4gNESNYdOBuzr-YhaXE4jIHlQTm_rSZkLxkiX1T9bT4HkuVgnrPuCTVFSFMuHbR75QAeq9y_ewY016Syg04sL7MiSSjUKHIJcgpHooSxRiGRQA3g Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 5021d13535274fa2b44666c8d39080bf Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:37:08.032966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5021d13535274fa2b44666c8d39080bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5021d13535274fa2b44666c8d39080bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5021d13535274fa2b44666c8d39080bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5021d13535274fa2b44666c8d39080bf"}]}] Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 5021d13535274fa2b44666c8d39080bf Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-DeleteServersTestJSON-373451192-project Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: c93191a5e3c7476f926b56424ccec4ba Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-DeleteServersTestJSON-373451192-project Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:08.034497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '488cdad7-8bac-4f8a-b412-851f6f2486a3'} Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:37:08.035245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:08.036541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:08.039101 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Returning 404 to user: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:37:08.040376 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d17c78b2-dc89-4065-8369-1948e786d037 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 404 len: 111 microversion: 2.1 time: 0.062563 Aug 08 13:37:08.044425 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 161/316] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:07 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:37:08.078581 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d75e3d76-e56d-4e2d-a9c8-01bf4d9886a8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:08.080612 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d75e3d76-e56d-4e2d-a9c8-01bf4d9886a8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:08.095727 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75e3d76-e56d-4e2d-a9c8-01bf4d9886a8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:08.096783 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75e3d76-e56d-4e2d-a9c8-01bf4d9886a8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:08.097750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75e3d76-e56d-4e2d-a9c8-01bf4d9886a8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:08.099465 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75e3d76-e56d-4e2d-a9c8-01bf4d9886a8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:08.101177 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75e3d76-e56d-4e2d-a9c8-01bf4d9886a8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:08.101982 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75e3d76-e56d-4e2d-a9c8-01bf4d9886a8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:08.231705 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:08.233321 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:08.244764 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:08.245261 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:08.245739 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:08.246622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:08.247321 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:08.247789 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:08.265772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] HTTP exception thrown: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Request method failure captured: Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3/os-volume_attachments HTTP/1.1 Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REVldU13qQtwTEYs2pKBJTyJDSJmkq-KnhBjp-qo1-LgPHR6c3x4UQtnhA_UHp4gNESNYdOBuzr-YhaXE4jIHlQTm_rSZkLxkiX1T9bT4HkuVgnrPuCTVFSFMuHbR75QAeq9y_ewY016Syg04sL7MiSSjUKHIJcgpHooSxRiGRQA3g Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 5021d13535274fa2b44666c8d39080bf Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:37:08.267444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5021d13535274fa2b44666c8d39080bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5021d13535274fa2b44666c8d39080bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5021d13535274fa2b44666c8d39080bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5021d13535274fa2b44666c8d39080bf"}]}] Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 5021d13535274fa2b44666c8d39080bf Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-DeleteServersTestJSON-373451192-project Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: c93191a5e3c7476f926b56424ccec4ba Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-DeleteServersTestJSON-373451192-project Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:08.268759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'server_id': '488cdad7-8bac-4f8a-b412-851f6f2486a3'} Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:37:08.269430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:08.270477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:08.274178 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Returning 404 to user: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:37:08.275426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-5770c6a3-101a-42ea-b659-c0fc90da21de tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051203 Aug 08 13:37:08.276186 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 162/317] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:37:08 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 13:37:08.312791 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-ebf4734b-d5b7-47cb-93d5-d71c17f47d99 req-76df6d74-5a98-4d71-bbb8-0203c34e8246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b337a957-cd21-4f51-aa36-f64ad24aee7c", "tag": "9caada1c-52b2-4c87-b709-be921f77a3b5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:37:08.339671 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-ebf4734b-d5b7-47cb-93d5-d71c17f47d99 req-76df6d74-5a98-4d71-bbb8-0203c34e8246 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:08.340476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-ebf4734b-d5b7-47cb-93d5-d71c17f47d99 req-76df6d74-5a98-4d71-bbb8-0203c34e8246 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:08.342030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-ebf4734b-d5b7-47cb-93d5-d71c17f47d99 req-76df6d74-5a98-4d71-bbb8-0203c34e8246 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:08.343126 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d75e3d76-e56d-4e2d-a9c8-01bf4d9886a8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:08.354932 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d75e3d76-e56d-4e2d-a9c8-01bf4d9886a8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.287794 Aug 08 13:37:08.359729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 156/318] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:08 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:08.368690 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-ebf4734b-d5b7-47cb-93d5-d71c17f47d99 req-76df6d74-5a98-4d71-bbb8-0203c34e8246 service nova] Creating event network-changed:9caada1c-52b2-4c87-b709-be921f77a3b5 for instance b337a957-cd21-4f51-aa36-f64ad24aee7c on hv-cinder-85199 Aug 08 13:37:08.381057 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-ebf4734b-d5b7-47cb-93d5-d71c17f47d99 req-76df6d74-5a98-4d71-bbb8-0203c34e8246 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085397 Aug 08 13:37:08.382912 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 163/319] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:37:08.468066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-bcd55c17-286d-4f59-9a3c-47ffef876783 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:08.484403 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-bcd55c17-286d-4f59-9a3c-47ffef876783 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:08.505221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bcd55c17-286d-4f59-9a3c-47ffef876783 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:08.505709 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bcd55c17-286d-4f59-9a3c-47ffef876783 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:08.506134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bcd55c17-286d-4f59-9a3c-47ffef876783 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:08.506859 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bcd55c17-286d-4f59-9a3c-47ffef876783 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:08.507364 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bcd55c17-286d-4f59-9a3c-47ffef876783 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:08.507784 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bcd55c17-286d-4f59-9a3c-47ffef876783 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:08.719592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-bcd55c17-286d-4f59-9a3c-47ffef876783 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:08.728552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-bcd55c17-286d-4f59-9a3c-47ffef876783 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.265764 Aug 08 13:37:08.729150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 157/320] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:08 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:09.388984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-733d6235-5990-417b-b5cc-a429143c3bd0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:09.390154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-733d6235-5990-417b-b5cc-a429143c3bd0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:09.399325 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-733d6235-5990-417b-b5cc-a429143c3bd0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:09.400001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-733d6235-5990-417b-b5cc-a429143c3bd0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:09.400726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-733d6235-5990-417b-b5cc-a429143c3bd0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:09.401553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-733d6235-5990-417b-b5cc-a429143c3bd0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:09.402092 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-733d6235-5990-417b-b5cc-a429143c3bd0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:09.402730 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-733d6235-5990-417b-b5cc-a429143c3bd0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:09.571905 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-733d6235-5990-417b-b5cc-a429143c3bd0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:09.587680 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-733d6235-5990-417b-b5cc-a429143c3bd0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.212124 Aug 08 13:37:09.588842 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 164/321] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:09 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:09.754276 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4f8da57b-0ab2-4553-a97b-56eb87276913 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:09.754909 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4f8da57b-0ab2-4553-a97b-56eb87276913 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:09.762400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8da57b-0ab2-4553-a97b-56eb87276913 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:09.762977 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8da57b-0ab2-4553-a97b-56eb87276913 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:09.763517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8da57b-0ab2-4553-a97b-56eb87276913 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:09.764507 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8da57b-0ab2-4553-a97b-56eb87276913 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:09.765175 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8da57b-0ab2-4553-a97b-56eb87276913 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:09.765712 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8da57b-0ab2-4553-a97b-56eb87276913 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:09.921414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4f8da57b-0ab2-4553-a97b-56eb87276913 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:09.932904 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4f8da57b-0ab2-4553-a97b-56eb87276913 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.182555 Aug 08 13:37:09.933515 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 158/322] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:09 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:10.618340 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ec7ee28b-571a-4683-8dbc-5ebbb7cec77a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:10.619214 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ec7ee28b-571a-4683-8dbc-5ebbb7cec77a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:10.626401 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec7ee28b-571a-4683-8dbc-5ebbb7cec77a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:10.626946 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec7ee28b-571a-4683-8dbc-5ebbb7cec77a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:10.627626 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec7ee28b-571a-4683-8dbc-5ebbb7cec77a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:10.628361 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec7ee28b-571a-4683-8dbc-5ebbb7cec77a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:10.628790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec7ee28b-571a-4683-8dbc-5ebbb7cec77a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:10.629304 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec7ee28b-571a-4683-8dbc-5ebbb7cec77a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:10.811693 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ec7ee28b-571a-4683-8dbc-5ebbb7cec77a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:10.820135 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ec7ee28b-571a-4683-8dbc-5ebbb7cec77a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.206275 Aug 08 13:37:10.820898 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 165/323] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:10 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:10.958014 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1d28e8b2-ee47-4f63-919d-2420cb69f091 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:10.958660 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1d28e8b2-ee47-4f63-919d-2420cb69f091 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:10.965939 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1d28e8b2-ee47-4f63-919d-2420cb69f091 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:10.966425 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1d28e8b2-ee47-4f63-919d-2420cb69f091 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:10.966851 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1d28e8b2-ee47-4f63-919d-2420cb69f091 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:10.967871 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1d28e8b2-ee47-4f63-919d-2420cb69f091 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:10.968316 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1d28e8b2-ee47-4f63-919d-2420cb69f091 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:10.968733 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1d28e8b2-ee47-4f63-919d-2420cb69f091 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:11.128249 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1d28e8b2-ee47-4f63-919d-2420cb69f091 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:11.136421 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1d28e8b2-ee47-4f63-919d-2420cb69f091 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.182458 Aug 08 13:37:11.137042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 159/324] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:10 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:11.842514 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-466fe0e8-0fbe-4fc3-ac2e-b0f1a64b3277 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:11.843441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-466fe0e8-0fbe-4fc3-ac2e-b0f1a64b3277 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:11.850410 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-466fe0e8-0fbe-4fc3-ac2e-b0f1a64b3277 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:11.850927 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-466fe0e8-0fbe-4fc3-ac2e-b0f1a64b3277 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:11.851392 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-466fe0e8-0fbe-4fc3-ac2e-b0f1a64b3277 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:11.852240 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-466fe0e8-0fbe-4fc3-ac2e-b0f1a64b3277 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:11.852706 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-466fe0e8-0fbe-4fc3-ac2e-b0f1a64b3277 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:11.853129 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-466fe0e8-0fbe-4fc3-ac2e-b0f1a64b3277 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:12.009598 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-466fe0e8-0fbe-4fc3-ac2e-b0f1a64b3277 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:12.018102 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-466fe0e8-0fbe-4fc3-ac2e-b0f1a64b3277 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.179689 Aug 08 13:37:12.018688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 166/325] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:11 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:12.162146 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4139003a-da27-47c4-9027-5a506735da11 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:12.163383 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4139003a-da27-47c4-9027-5a506735da11 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:12.174907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4139003a-da27-47c4-9027-5a506735da11 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:12.175571 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4139003a-da27-47c4-9027-5a506735da11 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:12.176034 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4139003a-da27-47c4-9027-5a506735da11 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:12.176849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4139003a-da27-47c4-9027-5a506735da11 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:12.177388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4139003a-da27-47c4-9027-5a506735da11 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:12.177895 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4139003a-da27-47c4-9027-5a506735da11 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:12.326006 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4139003a-da27-47c4-9027-5a506735da11 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:12.334503 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4139003a-da27-47c4-9027-5a506735da11 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.179807 Aug 08 13:37:12.335187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 160/326] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:12 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:13.040357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-386bbec9-187c-4c8d-9f40-1e52d0ab1509 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:13.041104 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-386bbec9-187c-4c8d-9f40-1e52d0ab1509 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:13.048519 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386bbec9-187c-4c8d-9f40-1e52d0ab1509 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:13.048870 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386bbec9-187c-4c8d-9f40-1e52d0ab1509 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:13.049418 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386bbec9-187c-4c8d-9f40-1e52d0ab1509 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:13.050194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386bbec9-187c-4c8d-9f40-1e52d0ab1509 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:13.050805 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386bbec9-187c-4c8d-9f40-1e52d0ab1509 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:13.051357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386bbec9-187c-4c8d-9f40-1e52d0ab1509 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:13.210565 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-386bbec9-187c-4c8d-9f40-1e52d0ab1509 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:13.219552 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-386bbec9-187c-4c8d-9f40-1e52d0ab1509 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.183541 Aug 08 13:37:13.220988 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 167/327] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:13 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:13.368676 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e9dee7ca-2b91-4ff7-ae3c-11313ecad0be tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:13.369528 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e9dee7ca-2b91-4ff7-ae3c-11313ecad0be tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:13.378678 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e9dee7ca-2b91-4ff7-ae3c-11313ecad0be tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:13.379457 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e9dee7ca-2b91-4ff7-ae3c-11313ecad0be tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:13.380178 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e9dee7ca-2b91-4ff7-ae3c-11313ecad0be tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:13.381177 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e9dee7ca-2b91-4ff7-ae3c-11313ecad0be tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:13.381870 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e9dee7ca-2b91-4ff7-ae3c-11313ecad0be tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:13.382396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e9dee7ca-2b91-4ff7-ae3c-11313ecad0be tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:13.537193 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e9dee7ca-2b91-4ff7-ae3c-11313ecad0be tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:13.546885 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e9dee7ca-2b91-4ff7-ae3c-11313ecad0be tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.182649 Aug 08 13:37:13.547653 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 161/328] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:13 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:14.244090 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-cd07f453-45d2-400e-8f08-a91190211e44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:14.244726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-cd07f453-45d2-400e-8f08-a91190211e44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:14.253738 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd07f453-45d2-400e-8f08-a91190211e44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:14.254637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd07f453-45d2-400e-8f08-a91190211e44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:14.255332 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd07f453-45d2-400e-8f08-a91190211e44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:14.256163 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd07f453-45d2-400e-8f08-a91190211e44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:14.256914 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd07f453-45d2-400e-8f08-a91190211e44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:14.257454 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd07f453-45d2-400e-8f08-a91190211e44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:14.573058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8e8f753e-a06d-4a15-98af-7abc74450269 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:14.574084 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8e8f753e-a06d-4a15-98af-7abc74450269 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:14.577665 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-cd07f453-45d2-400e-8f08-a91190211e44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:14.578703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:14.586592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e8f753e-a06d-4a15-98af-7abc74450269 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:14.587361 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e8f753e-a06d-4a15-98af-7abc74450269 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:14.588091 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e8f753e-a06d-4a15-98af-7abc74450269 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:14.589301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e8f753e-a06d-4a15-98af-7abc74450269 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:14.589966 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e8f753e-a06d-4a15-98af-7abc74450269 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:14.590941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e8f753e-a06d-4a15-98af-7abc74450269 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:14.595706 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-cd07f453-45d2-400e-8f08-a91190211e44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.355291 Aug 08 13:37:14.597235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 168/329] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:14 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:14.776383 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8e8f753e-a06d-4a15-98af-7abc74450269 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:14.785692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8e8f753e-a06d-4a15-98af-7abc74450269 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.219690 Aug 08 13:37:14.786279 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 162/330] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:14 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:15.622007 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7eec37c6-27dd-4668-be91-04b3278b86c8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:15.623746 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7eec37c6-27dd-4668-be91-04b3278b86c8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:15.636464 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7eec37c6-27dd-4668-be91-04b3278b86c8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:15.637657 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7eec37c6-27dd-4668-be91-04b3278b86c8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:15.638426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7eec37c6-27dd-4668-be91-04b3278b86c8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:15.639687 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7eec37c6-27dd-4668-be91-04b3278b86c8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:15.640540 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7eec37c6-27dd-4668-be91-04b3278b86c8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:15.641494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7eec37c6-27dd-4668-be91-04b3278b86c8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:15.818559 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-47d09771-f5c8-4acf-91b8-70f608542c98 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:15.820701 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-47d09771-f5c8-4acf-91b8-70f608542c98 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:15.834663 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d09771-f5c8-4acf-91b8-70f608542c98 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:15.835662 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d09771-f5c8-4acf-91b8-70f608542c98 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:15.836503 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d09771-f5c8-4acf-91b8-70f608542c98 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:15.839458 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d09771-f5c8-4acf-91b8-70f608542c98 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:15.840881 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d09771-f5c8-4acf-91b8-70f608542c98 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:15.842010 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d09771-f5c8-4acf-91b8-70f608542c98 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:15.994915 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7eec37c6-27dd-4668-be91-04b3278b86c8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:16.026228 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7eec37c6-27dd-4668-be91-04b3278b86c8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.410120 Aug 08 13:37:16.027195 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 169/331] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:15 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:16.062972 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:16.065745 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:16.081561 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:16.082463 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:16.083058 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:16.084308 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:16.085135 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:16.085905 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:16.102664 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-47d09771-f5c8-4acf-91b8-70f608542c98 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:16.116869 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] HTTP exception thrown: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Request method failure captured: Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: DELETE /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 HTTP/1.1 Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REVldU13qQtwTEYs2pKBJTyJDSJmkq-KnhBjp-qo1-LgPHR6c3x4UQtnhA_UHp4gNESNYdOBuzr-YhaXE4jIHlQTm_rSZkLxkiX1T9bT4HkuVgnrPuCTVFSFMuHbR75QAeq9y_ewY016Syg04sL7MiSSjUKHIJcgpHooSxRiGRQA3g Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 5021d13535274fa2b44666c8d39080bf Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:37:16.120649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5021d13535274fa2b44666c8d39080bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5021d13535274fa2b44666c8d39080bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5021d13535274fa2b44666c8d39080bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5021d13535274fa2b44666c8d39080bf"}]}] Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 5021d13535274fa2b44666c8d39080bf Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-DeleteServersTestJSON-373451192-project Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: c93191a5e3c7476f926b56424ccec4ba Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-DeleteServersTestJSON-373451192-project Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:16.123317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '488cdad7-8bac-4f8a-b412-851f6f2486a3'} Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:37:16.125851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:16.131421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:16.139021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Returning 404 to user: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:37:16.139021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-577b6c6e-99f6-451f-b2d7-5fdb1106aed2 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "DELETE /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 404 len: 111 microversion: 2.1 time: 0.083232 Aug 08 13:37:16.139021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 170/332] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:37:16 2022] DELETE /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:37:16.139021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:16.139021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] [instance: 488cdad7-8bac-4f8a-b412-851f6f2486a3] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:16.145728 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-47d09771-f5c8-4acf-91b8-70f608542c98 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.340648 Aug 08 13:37:16.150067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:16.150975 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:16.151771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:16.153013 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:16.153806 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:16.154556 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:16.159626 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 163/333] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:15 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:16.184019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] HTTP exception thrown: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Request method failure captured: Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 HTTP/1.1 Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REVldU13qQtwTEYs2pKBJTyJDSJmkq-KnhBjp-qo1-LgPHR6c3x4UQtnhA_UHp4gNESNYdOBuzr-YhaXE4jIHlQTm_rSZkLxkiX1T9bT4HkuVgnrPuCTVFSFMuHbR75QAeq9y_ewY016Syg04sL7MiSSjUKHIJcgpHooSxRiGRQA3g Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 5021d13535274fa2b44666c8d39080bf Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:37:16.187055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5021d13535274fa2b44666c8d39080bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5021d13535274fa2b44666c8d39080bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5021d13535274fa2b44666c8d39080bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5021d13535274fa2b44666c8d39080bf"}]}] Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 5021d13535274fa2b44666c8d39080bf Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-DeleteServersTestJSON-373451192 Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-DeleteServersTestJSON-373451192-project Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: c93191a5e3c7476f926b56424ccec4ba Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-DeleteServersTestJSON-373451192-project Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:16.188855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '488cdad7-8bac-4f8a-b412-851f6f2486a3'} Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:37:16.189511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. Aug 08 13:37:16.190622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:16.191716 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] Returning 404 to user: Instance 488cdad7-8bac-4f8a-b412-851f6f2486a3 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:37:16.191716 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1fc46395-3e74-472e-b3aa-f7bfa6983dc9 tempest-DeleteServersTestJSON-373451192 tempest-DeleteServersTestJSON-373451192-project] 10.222.0.33 "GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3" status: 404 len: 111 microversion: 2.1 time: 0.058618 Aug 08 13:37:16.191716 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 171/334] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:16 2022] GET /compute/v2.1/servers/488cdad7-8bac-4f8a-b412-851f6f2486a3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:37:17.064642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0610780f-862a-45c5-953c-f888b2e819e1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:17.065730 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0610780f-862a-45c5-953c-f888b2e819e1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:17.072731 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610780f-862a-45c5-953c-f888b2e819e1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:17.073205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610780f-862a-45c5-953c-f888b2e819e1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:17.073886 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610780f-862a-45c5-953c-f888b2e819e1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:17.074604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610780f-862a-45c5-953c-f888b2e819e1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:17.075618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610780f-862a-45c5-953c-f888b2e819e1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:17.075618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0610780f-862a-45c5-953c-f888b2e819e1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:17.189274 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-94be1f40-0ef3-4717-b7af-03237dca762a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:17.191343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-94be1f40-0ef3-4717-b7af-03237dca762a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:17.202279 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94be1f40-0ef3-4717-b7af-03237dca762a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:17.203652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94be1f40-0ef3-4717-b7af-03237dca762a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:17.204315 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94be1f40-0ef3-4717-b7af-03237dca762a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:17.206154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94be1f40-0ef3-4717-b7af-03237dca762a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:17.207243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94be1f40-0ef3-4717-b7af-03237dca762a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:17.208483 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-94be1f40-0ef3-4717-b7af-03237dca762a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:17.588544 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0610780f-862a-45c5-953c-f888b2e819e1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:17.604636 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-94be1f40-0ef3-4717-b7af-03237dca762a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:17.621033 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0610780f-862a-45c5-953c-f888b2e819e1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.560254 Aug 08 13:37:17.624360 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-94be1f40-0ef3-4717-b7af-03237dca762a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.440401 Aug 08 13:37:17.625885 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 172/335] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:17 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:17.630384 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 164/336] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:17 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:18.643136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-80f44155-e16b-4146-91b7-e7836825b692 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:18.644052 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-80f44155-e16b-4146-91b7-e7836825b692 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:18.650745 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80f44155-e16b-4146-91b7-e7836825b692 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:18.651138 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80f44155-e16b-4146-91b7-e7836825b692 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:18.651517 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80f44155-e16b-4146-91b7-e7836825b692 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:18.652427 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80f44155-e16b-4146-91b7-e7836825b692 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:18.652965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80f44155-e16b-4146-91b7-e7836825b692 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:18.653590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80f44155-e16b-4146-91b7-e7836825b692 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:18.661993 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2f17ab3c-f7b2-467d-80a4-05c855cc059a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:18.675434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2f17ab3c-f7b2-467d-80a4-05c855cc059a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:18.682684 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f17ab3c-f7b2-467d-80a4-05c855cc059a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:18.683307 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f17ab3c-f7b2-467d-80a4-05c855cc059a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:18.683800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f17ab3c-f7b2-467d-80a4-05c855cc059a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:18.684573 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f17ab3c-f7b2-467d-80a4-05c855cc059a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:18.685096 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f17ab3c-f7b2-467d-80a4-05c855cc059a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:18.685573 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f17ab3c-f7b2-467d-80a4-05c855cc059a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:18.954781 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-80f44155-e16b-4146-91b7-e7836825b692 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:18.965536 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-80f44155-e16b-4146-91b7-e7836825b692 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.325619 Aug 08 13:37:18.981218 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 173/337] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:18 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:19.007608 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2f17ab3c-f7b2-467d-80a4-05c855cc059a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:19.016029 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2f17ab3c-f7b2-467d-80a4-05c855cc059a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.361174 Aug 08 13:37:19.017556 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 165/338] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:18 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:19.998648 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a50f6fb0-ad96-4950-90f4-452a31b09630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:19.999545 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a50f6fb0-ad96-4950-90f4-452a31b09630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:20.007553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a50f6fb0-ad96-4950-90f4-452a31b09630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:20.007929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a50f6fb0-ad96-4950-90f4-452a31b09630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:20.008385 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a50f6fb0-ad96-4950-90f4-452a31b09630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:20.009089 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a50f6fb0-ad96-4950-90f4-452a31b09630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:20.009550 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a50f6fb0-ad96-4950-90f4-452a31b09630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:20.010309 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a50f6fb0-ad96-4950-90f4-452a31b09630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:20.037907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ff42e838-0c44-4123-a033-fde392dd566d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:20.038517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ff42e838-0c44-4123-a033-fde392dd566d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:20.047440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff42e838-0c44-4123-a033-fde392dd566d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:20.047927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff42e838-0c44-4123-a033-fde392dd566d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:20.048545 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff42e838-0c44-4123-a033-fde392dd566d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:20.049271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff42e838-0c44-4123-a033-fde392dd566d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:20.049726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff42e838-0c44-4123-a033-fde392dd566d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:20.050137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff42e838-0c44-4123-a033-fde392dd566d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:20.520995 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a50f6fb0-ad96-4950-90f4-452a31b09630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:20.530479 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a50f6fb0-ad96-4950-90f4-452a31b09630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.537501 Aug 08 13:37:20.531248 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 174/339] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:19 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:20.552862 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ff42e838-0c44-4123-a033-fde392dd566d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:20.560793 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ff42e838-0c44-4123-a033-fde392dd566d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.526712 Aug 08 13:37:20.561372 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 166/340] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:20 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:21.553485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2c12348e-6b29-4f81-a942-7b6868b6fd44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:21.554150 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2c12348e-6b29-4f81-a942-7b6868b6fd44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:21.560792 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c12348e-6b29-4f81-a942-7b6868b6fd44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:21.561282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c12348e-6b29-4f81-a942-7b6868b6fd44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:21.561755 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c12348e-6b29-4f81-a942-7b6868b6fd44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:21.562719 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c12348e-6b29-4f81-a942-7b6868b6fd44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:21.563203 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c12348e-6b29-4f81-a942-7b6868b6fd44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:21.563631 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2c12348e-6b29-4f81-a942-7b6868b6fd44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:21.582285 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-79e7bd53-d502-4931-8365-7b060bb10706 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:21.583340 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-79e7bd53-d502-4931-8365-7b060bb10706 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:21.590427 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79e7bd53-d502-4931-8365-7b060bb10706 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:21.590958 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79e7bd53-d502-4931-8365-7b060bb10706 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:21.591529 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79e7bd53-d502-4931-8365-7b060bb10706 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:21.592377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79e7bd53-d502-4931-8365-7b060bb10706 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:21.592825 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79e7bd53-d502-4931-8365-7b060bb10706 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:21.593311 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79e7bd53-d502-4931-8365-7b060bb10706 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:21.614935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=100 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:21.869206 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2c12348e-6b29-4f81-a942-7b6868b6fd44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:21.878683 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2c12348e-6b29-4f81-a942-7b6868b6fd44 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.328933 Aug 08 13:37:21.879511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 175/341] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:21 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:21.880388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-79e7bd53-d502-4931-8365-7b060bb10706 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:21.889641 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-79e7bd53-d502-4931-8365-7b060bb10706 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.311273 Aug 08 13:37:21.890299 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 167/342] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:21 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:22.916513 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-898044f7-b98b-46e7-9ea3-1e1f7b8c1952 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:22.917151 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a1ee1160-e5f7-4ca3-99e2-9627fcab31f9 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:22.918004 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a1ee1160-e5f7-4ca3-99e2-9627fcab31f9 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:22.918625 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-898044f7-b98b-46e7-9ea3-1e1f7b8c1952 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:22.927255 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1ee1160-e5f7-4ca3-99e2-9627fcab31f9 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:22.928319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1ee1160-e5f7-4ca3-99e2-9627fcab31f9 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:22.928999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1ee1160-e5f7-4ca3-99e2-9627fcab31f9 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:22.930098 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1ee1160-e5f7-4ca3-99e2-9627fcab31f9 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:22.930882 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1ee1160-e5f7-4ca3-99e2-9627fcab31f9 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:22.931554 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1ee1160-e5f7-4ca3-99e2-9627fcab31f9 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:22.932081 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-898044f7-b98b-46e7-9ea3-1e1f7b8c1952 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:22.932945 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-898044f7-b98b-46e7-9ea3-1e1f7b8c1952 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:22.934111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-898044f7-b98b-46e7-9ea3-1e1f7b8c1952 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:22.938887 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-898044f7-b98b-46e7-9ea3-1e1f7b8c1952 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:22.939871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-898044f7-b98b-46e7-9ea3-1e1f7b8c1952 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:22.940887 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-898044f7-b98b-46e7-9ea3-1e1f7b8c1952 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:23.201762 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-898044f7-b98b-46e7-9ea3-1e1f7b8c1952 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:23.210993 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-898044f7-b98b-46e7-9ea3-1e1f7b8c1952 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.306038 Aug 08 13:37:23.211928 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 176/343] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:22 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:23.362869 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a1ee1160-e5f7-4ca3-99e2-9627fcab31f9 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:23.374887 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a1ee1160-e5f7-4ca3-99e2-9627fcab31f9 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.462435 Aug 08 13:37:23.375929 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 168/344] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:22 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:24.041117 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-3fb629a6-4606-45ea-aaf6-189bf99c800a req-51abbc53-e2d7-46ba-adc4-b22b02d5bcad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e499da8-c64b-4053-b226-81dd1ca2cbee", "name": "network-vif-plugged", "status": "completed", "tag": "81eb53f9-0c92-420c-b3a2-7e1f0d216283"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:37:24.051062 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-3fb629a6-4606-45ea-aaf6-189bf99c800a req-51abbc53-e2d7-46ba-adc4-b22b02d5bcad service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:24.051561 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-3fb629a6-4606-45ea-aaf6-189bf99c800a req-51abbc53-e2d7-46ba-adc4-b22b02d5bcad service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:24.052181 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-3fb629a6-4606-45ea-aaf6-189bf99c800a req-51abbc53-e2d7-46ba-adc4-b22b02d5bcad service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:24.073108 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-3fb629a6-4606-45ea-aaf6-189bf99c800a req-51abbc53-e2d7-46ba-adc4-b22b02d5bcad service nova] Creating event network-vif-plugged:81eb53f9-0c92-420c-b3a2-7e1f0d216283 for instance 0e499da8-c64b-4053-b226-81dd1ca2cbee on hv-cinder-85199 Aug 08 13:37:24.080236 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-3fb629a6-4606-45ea-aaf6-189bf99c800a req-51abbc53-e2d7-46ba-adc4-b22b02d5bcad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042422 Aug 08 13:37:24.081699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 177/345] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:37:24.251625 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9ab71af7-3ee3-4fd0-9f07-5183a44c5600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:24.252238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9ab71af7-3ee3-4fd0-9f07-5183a44c5600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:24.260494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9ab71af7-3ee3-4fd0-9f07-5183a44c5600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:24.261306 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9ab71af7-3ee3-4fd0-9f07-5183a44c5600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:24.261957 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9ab71af7-3ee3-4fd0-9f07-5183a44c5600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:24.262897 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9ab71af7-3ee3-4fd0-9f07-5183a44c5600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:24.263553 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9ab71af7-3ee3-4fd0-9f07-5183a44c5600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:24.264302 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9ab71af7-3ee3-4fd0-9f07-5183a44c5600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:24.396979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-df8771ed-8671-40fa-ab81-d2365894eb1c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:24.397687 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-df8771ed-8671-40fa-ab81-d2365894eb1c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:24.410155 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df8771ed-8671-40fa-ab81-d2365894eb1c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:24.410652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df8771ed-8671-40fa-ab81-d2365894eb1c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:24.411068 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df8771ed-8671-40fa-ab81-d2365894eb1c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:24.411822 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df8771ed-8671-40fa-ab81-d2365894eb1c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:24.412276 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df8771ed-8671-40fa-ab81-d2365894eb1c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:24.412701 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df8771ed-8671-40fa-ab81-d2365894eb1c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:24.448724 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9ab71af7-3ee3-4fd0-9f07-5183a44c5600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:24.462749 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9ab71af7-3ee3-4fd0-9f07-5183a44c5600 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.215277 Aug 08 13:37:24.476178 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 169/346] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:24 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:24.636291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-df8771ed-8671-40fa-ab81-d2365894eb1c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:24.646762 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-df8771ed-8671-40fa-ab81-d2365894eb1c tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.254111 Aug 08 13:37:24.647682 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 178/347] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:24 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:25.485953 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4cfcb4de-4ca4-4722-ae09-0dc5f6f66cf2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:25.487709 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4cfcb4de-4ca4-4722-ae09-0dc5f6f66cf2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:25.495278 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4cfcb4de-4ca4-4722-ae09-0dc5f6f66cf2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:25.496270 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4cfcb4de-4ca4-4722-ae09-0dc5f6f66cf2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:25.497003 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4cfcb4de-4ca4-4722-ae09-0dc5f6f66cf2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:25.497972 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4cfcb4de-4ca4-4722-ae09-0dc5f6f66cf2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:25.498648 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4cfcb4de-4ca4-4722-ae09-0dc5f6f66cf2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:25.499389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4cfcb4de-4ca4-4722-ae09-0dc5f6f66cf2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:25.679051 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4c214c6d-6e4e-4b32-8154-e7e666b80143 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:25.682973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4c214c6d-6e4e-4b32-8154-e7e666b80143 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:25.697144 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c214c6d-6e4e-4b32-8154-e7e666b80143 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:25.698385 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c214c6d-6e4e-4b32-8154-e7e666b80143 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:25.699333 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c214c6d-6e4e-4b32-8154-e7e666b80143 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:25.719209 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c214c6d-6e4e-4b32-8154-e7e666b80143 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:25.721490 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c214c6d-6e4e-4b32-8154-e7e666b80143 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:25.724057 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c214c6d-6e4e-4b32-8154-e7e666b80143 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:25.790859 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4cfcb4de-4ca4-4722-ae09-0dc5f6f66cf2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:25.802828 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4cfcb4de-4ca4-4722-ae09-0dc5f6f66cf2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1521 microversion: 2.1 time: 0.321021 Aug 08 13:37:25.803894 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 170/348] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:25 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:25.948861 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4c214c6d-6e4e-4b32-8154-e7e666b80143 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:25.959243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4c214c6d-6e4e-4b32-8154-e7e666b80143 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1312 microversion: 2.1 time: 0.293308 Aug 08 13:37:25.959854 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 179/349] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:25 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1312 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:26.844571 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-caea8b35-c952-4e67-a2eb-65238363ced0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:26.846640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-caea8b35-c952-4e67-a2eb-65238363ced0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:26.859858 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-caea8b35-c952-4e67-a2eb-65238363ced0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:26.860881 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-caea8b35-c952-4e67-a2eb-65238363ced0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:26.861807 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-caea8b35-c952-4e67-a2eb-65238363ced0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:26.863401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-caea8b35-c952-4e67-a2eb-65238363ced0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:26.864218 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-caea8b35-c952-4e67-a2eb-65238363ced0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:26.865372 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-caea8b35-c952-4e67-a2eb-65238363ced0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:27.003569 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d9873eb7-287e-4e4e-beb8-2fd08428870b tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:27.006488 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d9873eb7-287e-4e4e-beb8-2fd08428870b tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:27.038475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d9873eb7-287e-4e4e-beb8-2fd08428870b tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:27.039976 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d9873eb7-287e-4e4e-beb8-2fd08428870b tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:27.041323 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d9873eb7-287e-4e4e-beb8-2fd08428870b tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:27.043071 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d9873eb7-287e-4e4e-beb8-2fd08428870b tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:27.044590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d9873eb7-287e-4e4e-beb8-2fd08428870b tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:27.047490 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d9873eb7-287e-4e4e-beb8-2fd08428870b tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:27.768078 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-caea8b35-c952-4e67-a2eb-65238363ced0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:27.779832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-caea8b35-c952-4e67-a2eb-65238363ced0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1501 microversion: 2.1 time: 0.944529 Aug 08 13:37:27.781109 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 171/350] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:26 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1501 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:27.816782 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d9873eb7-287e-4e4e-beb8-2fd08428870b tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:27.817373 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6e0aec97-cdeb-42ed-8959-0b07510b125e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:27.818296 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6e0aec97-cdeb-42ed-8959-0b07510b125e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:27.825447 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e0aec97-cdeb-42ed-8959-0b07510b125e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:27.826271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e0aec97-cdeb-42ed-8959-0b07510b125e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:27.826807 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e0aec97-cdeb-42ed-8959-0b07510b125e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:27.826986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d9873eb7-287e-4e4e-beb8-2fd08428870b tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1495 microversion: 2.1 time: 0.841586 Aug 08 13:37:27.827690 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 180/351] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:26 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1495 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:27.828351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e0aec97-cdeb-42ed-8959-0b07510b125e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:27.829206 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e0aec97-cdeb-42ed-8959-0b07510b125e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:27.829734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e0aec97-cdeb-42ed-8959-0b07510b125e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:28.065861 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6e0aec97-cdeb-42ed-8959-0b07510b125e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:28.074349 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6e0aec97-cdeb-42ed-8959-0b07510b125e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1514 microversion: 2.1 time: 0.261701 Aug 08 13:37:28.074987 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 172/352] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:27 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:33.180798 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-58e5652a-84e8-4049-b634-9a341f4c2f28 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:33.181372 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-58e5652a-84e8-4049-b634-9a341f4c2f28 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:33.183485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=68 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:33.188786 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58e5652a-84e8-4049-b634-9a341f4c2f28 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:33.189263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58e5652a-84e8-4049-b634-9a341f4c2f28 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:33.189684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58e5652a-84e8-4049-b634-9a341f4c2f28 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:33.190619 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58e5652a-84e8-4049-b634-9a341f4c2f28 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:33.191045 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58e5652a-84e8-4049-b634-9a341f4c2f28 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:33.191652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58e5652a-84e8-4049-b634-9a341f4c2f28 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:33.217525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-58e5652a-84e8-4049-b634-9a341f4c2f28 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Going to try to terminate instance {{(pid=124408) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:37:33.220476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:33.331657 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-58e5652a-84e8-4049-b634-9a341f4c2f28 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 204 len: 0 microversion: 2.1 time: 0.154020 Aug 08 13:37:33.332359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 181/353] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:37:33 2022] DELETE /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:37:33.342270 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5c4c4edb-e087-4fe6-885b-5b6ed2e3fc74 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:33.342919 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5c4c4edb-e087-4fe6-885b-5b6ed2e3fc74 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:33.350412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c4c4edb-e087-4fe6-885b-5b6ed2e3fc74 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:33.350947 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c4c4edb-e087-4fe6-885b-5b6ed2e3fc74 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:33.351457 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c4c4edb-e087-4fe6-885b-5b6ed2e3fc74 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:33.352257 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c4c4edb-e087-4fe6-885b-5b6ed2e3fc74 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:33.352744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c4c4edb-e087-4fe6-885b-5b6ed2e3fc74 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:33.353577 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c4c4edb-e087-4fe6-885b-5b6ed2e3fc74 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:33.507041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5c4c4edb-e087-4fe6-885b-5b6ed2e3fc74 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:33.514961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5c4c4edb-e087-4fe6-885b-5b6ed2e3fc74 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1501 microversion: 2.1 time: 0.177498 Aug 08 13:37:33.515554 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 173/354] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:33 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:34.536570 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3cc33de8-752e-42bc-a4d4-2ebf6d2195bc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:34.537289 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3cc33de8-752e-42bc-a4d4-2ebf6d2195bc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:34.543326 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3cc33de8-752e-42bc-a4d4-2ebf6d2195bc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:34.543814 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3cc33de8-752e-42bc-a4d4-2ebf6d2195bc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:34.544228 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3cc33de8-752e-42bc-a4d4-2ebf6d2195bc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:34.544910 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3cc33de8-752e-42bc-a4d4-2ebf6d2195bc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:34.545397 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3cc33de8-752e-42bc-a4d4-2ebf6d2195bc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:34.545771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3cc33de8-752e-42bc-a4d4-2ebf6d2195bc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:34.705628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3cc33de8-752e-42bc-a4d4-2ebf6d2195bc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:34.714144 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3cc33de8-752e-42bc-a4d4-2ebf6d2195bc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1501 microversion: 2.1 time: 0.181702 Aug 08 13:37:34.714735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 182/355] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:34 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:35.735928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-54c22326-25f6-43af-bd38-508b375ad823 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:35.736579 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-54c22326-25f6-43af-bd38-508b375ad823 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:35.744186 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-54c22326-25f6-43af-bd38-508b375ad823 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:35.744667 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-54c22326-25f6-43af-bd38-508b375ad823 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:35.745095 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-54c22326-25f6-43af-bd38-508b375ad823 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:35.745789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-54c22326-25f6-43af-bd38-508b375ad823 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:35.746230 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-54c22326-25f6-43af-bd38-508b375ad823 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:35.746647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-54c22326-25f6-43af-bd38-508b375ad823 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:35.901909 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-54c22326-25f6-43af-bd38-508b375ad823 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:35.910048 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-54c22326-25f6-43af-bd38-508b375ad823 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1501 microversion: 2.1 time: 0.178280 Aug 08 13:37:35.910609 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 174/356] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:35 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:36.930404 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-df63cc30-caff-4df2-90f1-04dd4dfb3377 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:36.931002 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-df63cc30-caff-4df2-90f1-04dd4dfb3377 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:36.937174 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df63cc30-caff-4df2-90f1-04dd4dfb3377 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:36.937661 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df63cc30-caff-4df2-90f1-04dd4dfb3377 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:36.938096 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df63cc30-caff-4df2-90f1-04dd4dfb3377 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:36.938789 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df63cc30-caff-4df2-90f1-04dd4dfb3377 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:36.939298 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df63cc30-caff-4df2-90f1-04dd4dfb3377 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:36.939736 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df63cc30-caff-4df2-90f1-04dd4dfb3377 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:37.084534 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-df63cc30-caff-4df2-90f1-04dd4dfb3377 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:37.093188 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-df63cc30-caff-4df2-90f1-04dd4dfb3377 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1501 microversion: 2.1 time: 0.166676 Aug 08 13:37:37.093835 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 183/357] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:36 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:38.115499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5632f102-c3df-4432-95ba-165d1cf5ae2f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:38.116214 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5632f102-c3df-4432-95ba-165d1cf5ae2f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:38.123204 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5632f102-c3df-4432-95ba-165d1cf5ae2f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:38.123688 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5632f102-c3df-4432-95ba-165d1cf5ae2f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:38.124156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5632f102-c3df-4432-95ba-165d1cf5ae2f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:38.124864 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5632f102-c3df-4432-95ba-165d1cf5ae2f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:38.125311 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5632f102-c3df-4432-95ba-165d1cf5ae2f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:38.125726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5632f102-c3df-4432-95ba-165d1cf5ae2f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:38.265901 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5632f102-c3df-4432-95ba-165d1cf5ae2f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:38.273811 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5632f102-c3df-4432-95ba-165d1cf5ae2f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1501 microversion: 2.1 time: 0.162618 Aug 08 13:37:38.274401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 175/358] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:38 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:39.212135 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-77931d49-be0d-4cc6-9a1d-22a236a0f13a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:37:39.214554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-77931d49-be0d-4cc6-9a1d-22a236a0f13a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:39.221768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-77931d49-be0d-4cc6-9a1d-22a236a0f13a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:39.222304 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-77931d49-be0d-4cc6-9a1d-22a236a0f13a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:39.223103 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-77931d49-be0d-4cc6-9a1d-22a236a0f13a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:39.223500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-77931d49-be0d-4cc6-9a1d-22a236a0f13a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:39.224035 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-77931d49-be0d-4cc6-9a1d-22a236a0f13a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:39.224459 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-77931d49-be0d-4cc6-9a1d-22a236a0f13a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:39.250509 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-77931d49-be0d-4cc6-9a1d-22a236a0f13a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lazy-loading 'flavor' on Instance uuid ff259851-1c4f-411c-b555-ded6a785a91d {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:37:39.296582 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5ac7ab51-11c1-4450-ac77-4d9269001efc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:39.297639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5ac7ab51-11c1-4450-ac77-4d9269001efc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:39.305097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac7ab51-11c1-4450-ac77-4d9269001efc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:39.305596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac7ab51-11c1-4450-ac77-4d9269001efc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:39.306107 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac7ab51-11c1-4450-ac77-4d9269001efc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:39.306893 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac7ab51-11c1-4450-ac77-4d9269001efc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:39.307394 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac7ab51-11c1-4450-ac77-4d9269001efc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:39.307915 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ac7ab51-11c1-4450-ac77-4d9269001efc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:39.332573 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-77931d49-be0d-4cc6-9a1d-22a236a0f13a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d/action" status: 200 len: 32 microversion: 2.1 time: 0.124520 Aug 08 13:37:39.333424 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 184/359] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:37:39 2022] POST /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 13:37:39.343864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-295c0524-e5bc-4ddd-97cb-294f797f2654 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:39.344606 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-295c0524-e5bc-4ddd-97cb-294f797f2654 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:39.351589 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-295c0524-e5bc-4ddd-97cb-294f797f2654 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:39.352201 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-295c0524-e5bc-4ddd-97cb-294f797f2654 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:39.352630 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-295c0524-e5bc-4ddd-97cb-294f797f2654 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:39.353338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-295c0524-e5bc-4ddd-97cb-294f797f2654 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:39.354139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-295c0524-e5bc-4ddd-97cb-294f797f2654 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:39.354321 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-295c0524-e5bc-4ddd-97cb-294f797f2654 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:39.551711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5ac7ab51-11c1-4450-ac77-4d9269001efc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:39.568789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5ac7ab51-11c1-4450-ac77-4d9269001efc tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1501 microversion: 2.1 time: 0.276068 Aug 08 13:37:39.570005 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 176/360] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:39 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1501 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:39.657609 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-295c0524-e5bc-4ddd-97cb-294f797f2654 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:39.666162 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-295c0524-e5bc-4ddd-97cb-294f797f2654 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.326953 Aug 08 13:37:39.666731 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 185/361] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:39 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:39.956766 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-30d7f922-06de-4049-807b-6ec0318be1bc req-35553983-9557-4d01-b357-594af6f13914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e499da8-c64b-4053-b226-81dd1ca2cbee", "name": "network-vif-deleted", "tag": "81eb53f9-0c92-420c-b3a2-7e1f0d216283"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:37:39.969502 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-30d7f922-06de-4049-807b-6ec0318be1bc req-35553983-9557-4d01-b357-594af6f13914 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:39.970030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-30d7f922-06de-4049-807b-6ec0318be1bc req-35553983-9557-4d01-b357-594af6f13914 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:39.971192 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-30d7f922-06de-4049-807b-6ec0318be1bc req-35553983-9557-4d01-b357-594af6f13914 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:39.988901 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-30d7f922-06de-4049-807b-6ec0318be1bc req-35553983-9557-4d01-b357-594af6f13914 service nova] Creating event network-vif-deleted:81eb53f9-0c92-420c-b3a2-7e1f0d216283 for instance 0e499da8-c64b-4053-b226-81dd1ca2cbee on hv-cinder-85199 Aug 08 13:37:39.994860 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-30d7f922-06de-4049-807b-6ec0318be1bc req-35553983-9557-4d01-b357-594af6f13914 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041711 Aug 08 13:37:39.995499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 177/362] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:37:40.591015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:40.591642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:40.598519 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:40.599018 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:40.599505 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:40.600217 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:40.600666 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:40.601085 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:40.637020 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:40.637641 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:40.638090 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:40.638544 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lazy-loading 'fault' on Instance uuid 0e499da8-c64b-4053-b226-81dd1ca2cbee {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:37:40.689027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3e548494-74df-4ce2-9f93-f50017811bdc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:40.690496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3e548494-74df-4ce2-9f93-f50017811bdc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:40.697886 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e548494-74df-4ce2-9f93-f50017811bdc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:40.698574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e548494-74df-4ce2-9f93-f50017811bdc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:40.699235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e548494-74df-4ce2-9f93-f50017811bdc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:40.700200 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e548494-74df-4ce2-9f93-f50017811bdc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:40.700838 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e548494-74df-4ce2-9f93-f50017811bdc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:40.701541 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e548494-74df-4ce2-9f93-f50017811bdc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:40.705718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:40.715830 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3c145477-a38f-4b6b-b0b0-03280604d642 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 200 len: 1302 microversion: 2.1 time: 0.129508 Aug 08 13:37:40.716808 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 186/363] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:40 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 1302 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:40.941816 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3e548494-74df-4ce2-9f93-f50017811bdc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:40.955980 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3e548494-74df-4ce2-9f93-f50017811bdc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.270844 Aug 08 13:37:40.957402 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 178/364] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:40 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:41.744236 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:41.746674 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 0e499da8-c64b-4053-b226-81dd1ca2cbee] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:41.754737 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:41.755558 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:41.756265 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:41.757345 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:41.757955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:41.758590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:41.787928 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] HTTP exception thrown: Instance 0e499da8-c64b-4053-b226-81dd1ca2cbee could not be found. Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Request method failure captured: Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee HTTP/1.1 Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8RFj3E7qttLdHfrg7HM6xNhXYhhTgGPHVBcPA3hYFEzi7idxgfKiW1mLTunOoJDvJipFqqXDupLs-OOmPfIcZFIWOryqtSjmv8nCfwxkZpzrUho2EwqTrzZU2yUznYhhhpGmmqgvfC-LpJ-xG91Vnwxu86JhwC5aO8iMf8sFxUu-EYs Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 830ccc10c7284fc2942b49cd091e942a Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-VolumesActionsTest-938170610 Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:37:41.789616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/830ccc10c7284fc2942b49cd091e942a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_830ccc10c7284fc2942b49cd091e942a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/830ccc10c7284fc2942b49cd091e942a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/830ccc10c7284fc2942b49cd091e942a"}]}] Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-VolumesActionsTest-938170610 Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 830ccc10c7284fc2942b49cd091e942a Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-VolumesActionsTest-938170610 Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-VolumesActionsTest-938170610-project Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: bd8f3afb4bf040c58feb266b45c0f503 Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-VolumesActionsTest-938170610-project Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 0e499da8-c64b-4053-b226-81dd1ca2cbee could not be found. Aug 08 13:37:41.791383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '0e499da8-c64b-4053-b226-81dd1ca2cbee'} Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e499da8-c64b-4053-b226-81dd1ca2cbee could not be found. Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:37:41.792109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e499da8-c64b-4053-b226-81dd1ca2cbee could not be found. Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e499da8-c64b-4053-b226-81dd1ca2cbee could not be found. Aug 08 13:37:41.793317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:37:41.794404 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Returning 404 to user: Instance 0e499da8-c64b-4053-b226-81dd1ca2cbee could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:37:41.794655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7da432fe-aa39-4a81-b346-44e353d5f90a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee" status: 404 len: 111 microversion: 2.1 time: 0.058270 Aug 08 13:37:41.795997 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 187/365] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:41 2022] GET /compute/v2.1/servers/0e499da8-c64b-4053-b226-81dd1ca2cbee => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:37:41.995129 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e294af51-123c-4022-a55b-4e2b912909fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:41.995837 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e294af51-123c-4022-a55b-4e2b912909fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:42.002569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e294af51-123c-4022-a55b-4e2b912909fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:42.003047 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e294af51-123c-4022-a55b-4e2b912909fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:42.003755 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e294af51-123c-4022-a55b-4e2b912909fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:42.004469 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e294af51-123c-4022-a55b-4e2b912909fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:42.004921 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e294af51-123c-4022-a55b-4e2b912909fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:42.005346 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e294af51-123c-4022-a55b-4e2b912909fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:42.018043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-924685838", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "networks": [{"uuid": "09150fa1-6ee9-44f6-a8b5-e2d6557f28b4"}]}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:37:42.105532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] validate_networks() for [('09150fa1-6ee9-44f6-a8b5-e2d6557f28b4', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:37:42.250868 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e294af51-123c-4022-a55b-4e2b912909fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:42.260079 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e294af51-123c-4022-a55b-4e2b912909fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.286022 Aug 08 13:37:42.261039 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 179/366] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:41 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:42.542746 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:37:42.543394 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:37:42.544587 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:37:42.544587 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:37:42.545063 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:37:42.554291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:42.554760 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:42.555215 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:42.555938 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:42.556371 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:42.556782 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:42.577705 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Getting quotas for project 830ccc10c7284fc2942b49cd091e942a. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:37:42.582882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Getting quotas for user bd8f3afb4bf040c58feb266b45c0f503 and project 830ccc10c7284fc2942b49cd091e942a. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:37:42.595447 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:37:42.597720 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:37:42.648112 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-cdd7a868-0113-44de-a030-c6c7cf640532 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634554 Aug 08 13:37:42.648768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 188/367] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:37:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:37:42.664261 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b5a81205-e718-45ab-b8fb-f44933edb51f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:42.665310 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b5a81205-e718-45ab-b8fb-f44933edb51f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:42.741434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b5a81205-e718-45ab-b8fb-f44933edb51f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:42.748386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b5a81205-e718-45ab-b8fb-f44933edb51f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1213 microversion: 2.1 time: 0.091449 Aug 08 13:37:42.749125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 180/368] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:42 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:43.282990 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e3769319-b04f-4eb2-9324-54871d8c37d0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:43.283838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e3769319-b04f-4eb2-9324-54871d8c37d0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:43.291732 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3769319-b04f-4eb2-9324-54871d8c37d0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:43.292416 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3769319-b04f-4eb2-9324-54871d8c37d0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:43.292888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3769319-b04f-4eb2-9324-54871d8c37d0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:43.293801 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3769319-b04f-4eb2-9324-54871d8c37d0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:43.294451 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3769319-b04f-4eb2-9324-54871d8c37d0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:43.294972 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3769319-b04f-4eb2-9324-54871d8c37d0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:43.465568 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e3769319-b04f-4eb2-9324-54871d8c37d0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:43.474284 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e3769319-b04f-4eb2-9324-54871d8c37d0 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.195899 Aug 08 13:37:43.474873 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 189/369] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:43 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:43.769974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0dd214f6-a76e-4170-82e2-deb051a1e244 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:43.770545 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0dd214f6-a76e-4170-82e2-deb051a1e244 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:43.777399 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0dd214f6-a76e-4170-82e2-deb051a1e244 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:43.777880 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0dd214f6-a76e-4170-82e2-deb051a1e244 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:43.778396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0dd214f6-a76e-4170-82e2-deb051a1e244 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:43.779103 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0dd214f6-a76e-4170-82e2-deb051a1e244 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:43.779765 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0dd214f6-a76e-4170-82e2-deb051a1e244 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:43.780210 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0dd214f6-a76e-4170-82e2-deb051a1e244 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:43.874817 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0dd214f6-a76e-4170-82e2-deb051a1e244 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:43.883233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0dd214f6-a76e-4170-82e2-deb051a1e244 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1265 microversion: 2.1 time: 0.117232 Aug 08 13:37:43.883808 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 181/370] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:43 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:44.497572 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5a9de3c2-8373-41eb-a8c5-19a24478f59e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:44.498267 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-5a9de3c2-8373-41eb-a8c5-19a24478f59e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:44.507113 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5a9de3c2-8373-41eb-a8c5-19a24478f59e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:44.507759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5a9de3c2-8373-41eb-a8c5-19a24478f59e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:44.508328 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5a9de3c2-8373-41eb-a8c5-19a24478f59e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:44.509151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5a9de3c2-8373-41eb-a8c5-19a24478f59e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:44.509635 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5a9de3c2-8373-41eb-a8c5-19a24478f59e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:44.510077 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5a9de3c2-8373-41eb-a8c5-19a24478f59e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:44.756184 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-5a9de3c2-8373-41eb-a8c5-19a24478f59e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:44.765294 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-5a9de3c2-8373-41eb-a8c5-19a24478f59e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.271865 Aug 08 13:37:44.766056 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 190/371] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:44 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:44.904601 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-22b2d062-c096-4d7c-9c3c-b87ed4853820 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:44.905284 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-22b2d062-c096-4d7c-9c3c-b87ed4853820 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:44.908251 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=42 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:44.914802 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22b2d062-c096-4d7c-9c3c-b87ed4853820 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:44.915453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22b2d062-c096-4d7c-9c3c-b87ed4853820 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:44.915900 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22b2d062-c096-4d7c-9c3c-b87ed4853820 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:44.916613 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22b2d062-c096-4d7c-9c3c-b87ed4853820 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:44.917088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22b2d062-c096-4d7c-9c3c-b87ed4853820 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:44.917526 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22b2d062-c096-4d7c-9c3c-b87ed4853820 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:45.148953 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-22b2d062-c096-4d7c-9c3c-b87ed4853820 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:45.156899 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-22b2d062-c096-4d7c-9c3c-b87ed4853820 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.256275 Aug 08 13:37:45.157820 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 182/372] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:44 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:45.477515 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-2bd36517-fae4-44cf-a894-8728f9f1548a req-34bfe1c4-e0c3-47bf-870c-2786c086d444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe7838c-1f9e-47bd-a585-149d2ca62fc1", "tag": "6a33552b-46f9-4df5-94de-6f13339df1e9"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:37:45.502679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-2bd36517-fae4-44cf-a894-8728f9f1548a req-34bfe1c4-e0c3-47bf-870c-2786c086d444 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:45.503785 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-2bd36517-fae4-44cf-a894-8728f9f1548a req-34bfe1c4-e0c3-47bf-870c-2786c086d444 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:45.504439 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-2bd36517-fae4-44cf-a894-8728f9f1548a req-34bfe1c4-e0c3-47bf-870c-2786c086d444 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:45.538150 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-2bd36517-fae4-44cf-a894-8728f9f1548a req-34bfe1c4-e0c3-47bf-870c-2786c086d444 service nova] Creating event network-changed:6a33552b-46f9-4df5-94de-6f13339df1e9 for instance 4fe7838c-1f9e-47bd-a585-149d2ca62fc1 on hv-cinder-85199 Aug 08 13:37:45.543831 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-2bd36517-fae4-44cf-a894-8728f9f1548a req-34bfe1c4-e0c3-47bf-870c-2786c086d444 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075249 Aug 08 13:37:45.544709 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 191/373] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:37:45.787504 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fddd0999-e893-4c54-8f15-972b0f295924 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:45.788121 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-fddd0999-e893-4c54-8f15-972b0f295924 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:45.798708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fddd0999-e893-4c54-8f15-972b0f295924 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:45.798708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fddd0999-e893-4c54-8f15-972b0f295924 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:45.798708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fddd0999-e893-4c54-8f15-972b0f295924 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:45.798708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fddd0999-e893-4c54-8f15-972b0f295924 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:45.799252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fddd0999-e893-4c54-8f15-972b0f295924 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:45.799252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fddd0999-e893-4c54-8f15-972b0f295924 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:46.060428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-fddd0999-e893-4c54-8f15-972b0f295924 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:46.069318 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-fddd0999-e893-4c54-8f15-972b0f295924 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.286465 Aug 08 13:37:46.069982 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 183/374] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:45 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:46.180498 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7dc9e939-a9ca-4350-b0e9-13e811545be8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:46.181100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7dc9e939-a9ca-4350-b0e9-13e811545be8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:46.188335 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7dc9e939-a9ca-4350-b0e9-13e811545be8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:46.188929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7dc9e939-a9ca-4350-b0e9-13e811545be8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:46.189363 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7dc9e939-a9ca-4350-b0e9-13e811545be8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:46.191306 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7dc9e939-a9ca-4350-b0e9-13e811545be8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:46.191306 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7dc9e939-a9ca-4350-b0e9-13e811545be8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:46.191708 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7dc9e939-a9ca-4350-b0e9-13e811545be8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:46.332666 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7dc9e939-a9ca-4350-b0e9-13e811545be8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:46.342729 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7dc9e939-a9ca-4350-b0e9-13e811545be8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.167671 Aug 08 13:37:46.343503 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 192/375] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:46 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:47.091230 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e911e927-8b2c-4f5c-bb44-088dc436c2e5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:47.092149 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e911e927-8b2c-4f5c-bb44-088dc436c2e5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:47.099209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e911e927-8b2c-4f5c-bb44-088dc436c2e5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:47.099683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e911e927-8b2c-4f5c-bb44-088dc436c2e5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:47.100338 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e911e927-8b2c-4f5c-bb44-088dc436c2e5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:47.101135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e911e927-8b2c-4f5c-bb44-088dc436c2e5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:47.101663 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e911e927-8b2c-4f5c-bb44-088dc436c2e5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:47.102280 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e911e927-8b2c-4f5c-bb44-088dc436c2e5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:47.283392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e911e927-8b2c-4f5c-bb44-088dc436c2e5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:47.294257 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e911e927-8b2c-4f5c-bb44-088dc436c2e5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.207031 Aug 08 13:37:47.294873 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 184/376] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:47 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:47.364192 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7ff2ec97-5f1d-4d1c-97a4-5f6b544b295a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:47.364796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7ff2ec97-5f1d-4d1c-97a4-5f6b544b295a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:47.374267 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ff2ec97-5f1d-4d1c-97a4-5f6b544b295a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:47.375029 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ff2ec97-5f1d-4d1c-97a4-5f6b544b295a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:47.375600 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ff2ec97-5f1d-4d1c-97a4-5f6b544b295a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:47.376636 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ff2ec97-5f1d-4d1c-97a4-5f6b544b295a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:47.377204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ff2ec97-5f1d-4d1c-97a4-5f6b544b295a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:47.377641 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ff2ec97-5f1d-4d1c-97a4-5f6b544b295a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:47.517268 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7ff2ec97-5f1d-4d1c-97a4-5f6b544b295a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:47.525346 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7ff2ec97-5f1d-4d1c-97a4-5f6b544b295a tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.165881 Aug 08 13:37:47.525952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 193/377] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:47 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:48.315709 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-073372cd-3354-4040-a0d6-fd9261dc5c5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:48.316330 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-073372cd-3354-4040-a0d6-fd9261dc5c5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:48.323022 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-073372cd-3354-4040-a0d6-fd9261dc5c5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:48.323463 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-073372cd-3354-4040-a0d6-fd9261dc5c5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:48.323927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-073372cd-3354-4040-a0d6-fd9261dc5c5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:48.324609 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-073372cd-3354-4040-a0d6-fd9261dc5c5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:48.325050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-073372cd-3354-4040-a0d6-fd9261dc5c5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:48.325460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-073372cd-3354-4040-a0d6-fd9261dc5c5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:48.546546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-47af7b39-1b3b-45e4-8b81-fe895bb06015 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:48.547341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-47af7b39-1b3b-45e4-8b81-fe895bb06015 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:48.550750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-073372cd-3354-4040-a0d6-fd9261dc5c5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:48.554303 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=100 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:48.556775 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47af7b39-1b3b-45e4-8b81-fe895bb06015 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:48.557365 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47af7b39-1b3b-45e4-8b81-fe895bb06015 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:48.557852 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47af7b39-1b3b-45e4-8b81-fe895bb06015 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:48.558889 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47af7b39-1b3b-45e4-8b81-fe895bb06015 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:48.559214 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-073372cd-3354-4040-a0d6-fd9261dc5c5a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.247390 Aug 08 13:37:48.559589 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47af7b39-1b3b-45e4-8b81-fe895bb06015 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:48.562092 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 185/378] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:48 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:48.562312 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-47af7b39-1b3b-45e4-8b81-fe895bb06015 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:48.710336 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-47af7b39-1b3b-45e4-8b81-fe895bb06015 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:48.728158 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-47af7b39-1b3b-45e4-8b81-fe895bb06015 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.185562 Aug 08 13:37:48.728742 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 194/379] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:48 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:37:49.583179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e79e2af8-2a98-47cf-b6eb-0090d756d4a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:49.584674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e79e2af8-2a98-47cf-b6eb-0090d756d4a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:49.592170 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e79e2af8-2a98-47cf-b6eb-0090d756d4a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:49.593046 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e79e2af8-2a98-47cf-b6eb-0090d756d4a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:49.593663 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e79e2af8-2a98-47cf-b6eb-0090d756d4a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:49.594833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e79e2af8-2a98-47cf-b6eb-0090d756d4a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:49.595672 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e79e2af8-2a98-47cf-b6eb-0090d756d4a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:49.596341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e79e2af8-2a98-47cf-b6eb-0090d756d4a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:49.750120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8c25e84e-d3aa-4115-a4b1-bf7c9aafb4d7 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:49.750738 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8c25e84e-d3aa-4115-a4b1-bf7c9aafb4d7 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:49.756873 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c25e84e-d3aa-4115-a4b1-bf7c9aafb4d7 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:49.758268 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c25e84e-d3aa-4115-a4b1-bf7c9aafb4d7 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:49.758761 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c25e84e-d3aa-4115-a4b1-bf7c9aafb4d7 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:49.759821 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c25e84e-d3aa-4115-a4b1-bf7c9aafb4d7 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:49.760607 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c25e84e-d3aa-4115-a4b1-bf7c9aafb4d7 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:49.761260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c25e84e-d3aa-4115-a4b1-bf7c9aafb4d7 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:49.907876 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e79e2af8-2a98-47cf-b6eb-0090d756d4a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:49.920041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e79e2af8-2a98-47cf-b6eb-0090d756d4a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.342628 Aug 08 13:37:49.932334 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 186/380] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:49 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:50.005338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8c25e84e-d3aa-4115-a4b1-bf7c9aafb4d7 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:50.013757 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8c25e84e-d3aa-4115-a4b1-bf7c9aafb4d7 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.267814 Aug 08 13:37:50.019674 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 195/381] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:49 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:50.944451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d29d375d-ae6e-48b0-af21-1ceb1c55c2a4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:50.945179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d29d375d-ae6e-48b0-af21-1ceb1c55c2a4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:50.951844 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d29d375d-ae6e-48b0-af21-1ceb1c55c2a4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:50.952319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d29d375d-ae6e-48b0-af21-1ceb1c55c2a4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:50.952749 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d29d375d-ae6e-48b0-af21-1ceb1c55c2a4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:50.953456 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d29d375d-ae6e-48b0-af21-1ceb1c55c2a4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:50.953913 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d29d375d-ae6e-48b0-af21-1ceb1c55c2a4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:50.954327 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d29d375d-ae6e-48b0-af21-1ceb1c55c2a4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:51.035577 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-513cde25-6453-410b-be94-64a30e34d489 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:51.036329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-513cde25-6453-410b-be94-64a30e34d489 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:51.044203 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-513cde25-6453-410b-be94-64a30e34d489 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:51.044689 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-513cde25-6453-410b-be94-64a30e34d489 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:51.045110 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-513cde25-6453-410b-be94-64a30e34d489 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:51.045809 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-513cde25-6453-410b-be94-64a30e34d489 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:51.046259 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-513cde25-6453-410b-be94-64a30e34d489 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:51.046697 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-513cde25-6453-410b-be94-64a30e34d489 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:51.062880 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:51.104850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d29d375d-ae6e-48b0-af21-1ceb1c55c2a4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:51.113190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d29d375d-ae6e-48b0-af21-1ceb1c55c2a4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.172780 Aug 08 13:37:51.113764 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 187/382] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:50 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:51.435875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-513cde25-6453-410b-be94-64a30e34d489 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:51.443673 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-513cde25-6453-410b-be94-64a30e34d489 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.412189 Aug 08 13:37:51.444254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 196/383] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:51 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:52.134146 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-190f642a-eac3-4c30-821d-a60e01f20408 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:52.135006 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-190f642a-eac3-4c30-821d-a60e01f20408 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:52.141308 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-190f642a-eac3-4c30-821d-a60e01f20408 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:52.141792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-190f642a-eac3-4c30-821d-a60e01f20408 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:52.142230 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-190f642a-eac3-4c30-821d-a60e01f20408 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:52.142925 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-190f642a-eac3-4c30-821d-a60e01f20408 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:52.143394 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-190f642a-eac3-4c30-821d-a60e01f20408 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:52.143813 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-190f642a-eac3-4c30-821d-a60e01f20408 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:52.198425 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-bd36b421-712f-41e8-bad7-7e08ea16988b req-5596ac8b-bbc8-42a7-89a1-2ef509118abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe7838c-1f9e-47bd-a585-149d2ca62fc1", "name": "network-vif-plugged", "status": "completed", "tag": "6a33552b-46f9-4df5-94de-6f13339df1e9"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:37:52.214259 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-bd36b421-712f-41e8-bad7-7e08ea16988b req-5596ac8b-bbc8-42a7-89a1-2ef509118abf service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:52.214850 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-bd36b421-712f-41e8-bad7-7e08ea16988b req-5596ac8b-bbc8-42a7-89a1-2ef509118abf service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:52.215648 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-bd36b421-712f-41e8-bad7-7e08ea16988b req-5596ac8b-bbc8-42a7-89a1-2ef509118abf service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:52.228478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-bd36b421-712f-41e8-bad7-7e08ea16988b req-5596ac8b-bbc8-42a7-89a1-2ef509118abf service nova] Creating event network-vif-plugged:6a33552b-46f9-4df5-94de-6f13339df1e9 for instance 4fe7838c-1f9e-47bd-a585-149d2ca62fc1 on hv-cinder-85199 Aug 08 13:37:52.235545 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-bd36b421-712f-41e8-bad7-7e08ea16988b req-5596ac8b-bbc8-42a7-89a1-2ef509118abf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041105 Aug 08 13:37:52.236764 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 197/384] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:37:52.283614 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-190f642a-eac3-4c30-821d-a60e01f20408 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:52.291231 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-190f642a-eac3-4c30-821d-a60e01f20408 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.161067 Aug 08 13:37:52.291805 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 188/385] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:52 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:52.467868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f0b66ddb-0623-4186-a4c6-acffe3142e61 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:52.468765 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f0b66ddb-0623-4186-a4c6-acffe3142e61 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:52.476013 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0b66ddb-0623-4186-a4c6-acffe3142e61 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:52.476561 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0b66ddb-0623-4186-a4c6-acffe3142e61 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:52.476989 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0b66ddb-0623-4186-a4c6-acffe3142e61 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:52.477714 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0b66ddb-0623-4186-a4c6-acffe3142e61 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:52.478195 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0b66ddb-0623-4186-a4c6-acffe3142e61 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:52.478610 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0b66ddb-0623-4186-a4c6-acffe3142e61 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:52.566886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:52.590502 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:52.622997 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-f0b66ddb-0623-4186-a4c6-acffe3142e61 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:52.631106 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f0b66ddb-0623-4186-a4c6-acffe3142e61 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.169267 Aug 08 13:37:52.631707 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 198/386] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:52 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:53.312744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a6923962-80e4-48e3-9088-4e0e3cc54698 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:53.313292 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a6923962-80e4-48e3-9088-4e0e3cc54698 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:53.315660 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:37:53.325997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a6923962-80e4-48e3-9088-4e0e3cc54698 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:53.326863 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a6923962-80e4-48e3-9088-4e0e3cc54698 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:53.327674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a6923962-80e4-48e3-9088-4e0e3cc54698 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:53.328946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a6923962-80e4-48e3-9088-4e0e3cc54698 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:53.329764 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a6923962-80e4-48e3-9088-4e0e3cc54698 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:53.330522 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a6923962-80e4-48e3-9088-4e0e3cc54698 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:53.557671 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a6923962-80e4-48e3-9088-4e0e3cc54698 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:53.566209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a6923962-80e4-48e3-9088-4e0e3cc54698 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.257432 Aug 08 13:37:53.566716 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 189/387] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:53 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:53.654141 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-18017769-9d20-4664-8d1b-16a2b4463727 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:53.654851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-18017769-9d20-4664-8d1b-16a2b4463727 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:53.662964 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18017769-9d20-4664-8d1b-16a2b4463727 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:53.663486 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18017769-9d20-4664-8d1b-16a2b4463727 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:53.663942 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18017769-9d20-4664-8d1b-16a2b4463727 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:53.664853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18017769-9d20-4664-8d1b-16a2b4463727 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:53.665436 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18017769-9d20-4664-8d1b-16a2b4463727 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:53.666099 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-18017769-9d20-4664-8d1b-16a2b4463727 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:53.813140 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-18017769-9d20-4664-8d1b-16a2b4463727 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:53.821001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-18017769-9d20-4664-8d1b-16a2b4463727 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.172329 Aug 08 13:37:53.821499 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 199/388] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:53 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:54.588791 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ff9a915b-771c-4b34-835c-306cb8a569b9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:54.589343 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ff9a915b-771c-4b34-835c-306cb8a569b9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:54.599947 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff9a915b-771c-4b34-835c-306cb8a569b9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:54.600775 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff9a915b-771c-4b34-835c-306cb8a569b9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:54.601629 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff9a915b-771c-4b34-835c-306cb8a569b9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:54.602819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff9a915b-771c-4b34-835c-306cb8a569b9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:54.603674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff9a915b-771c-4b34-835c-306cb8a569b9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:54.604443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff9a915b-771c-4b34-835c-306cb8a569b9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:54.750525 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ff9a915b-771c-4b34-835c-306cb8a569b9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:54.759120 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ff9a915b-771c-4b34-835c-306cb8a569b9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.174250 Aug 08 13:37:54.759847 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 190/389] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:54 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:54.846682 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fd662fbf-dbd7-4a48-b069-4516e107cc37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:54.847261 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fd662fbf-dbd7-4a48-b069-4516e107cc37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:54.853800 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fd662fbf-dbd7-4a48-b069-4516e107cc37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:54.854288 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fd662fbf-dbd7-4a48-b069-4516e107cc37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:54.854742 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fd662fbf-dbd7-4a48-b069-4516e107cc37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:54.855487 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fd662fbf-dbd7-4a48-b069-4516e107cc37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:54.855969 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fd662fbf-dbd7-4a48-b069-4516e107cc37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:54.856362 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fd662fbf-dbd7-4a48-b069-4516e107cc37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:55.003383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fd662fbf-dbd7-4a48-b069-4516e107cc37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:55.011044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fd662fbf-dbd7-4a48-b069-4516e107cc37 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.168477 Aug 08 13:37:55.011855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 200/390] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:54 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:55.781379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-45de2f0a-a49d-4a93-8d70-d1300b02c217 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:55.782003 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-45de2f0a-a49d-4a93-8d70-d1300b02c217 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:55.789091 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-45de2f0a-a49d-4a93-8d70-d1300b02c217 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:55.789582 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-45de2f0a-a49d-4a93-8d70-d1300b02c217 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:55.790002 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-45de2f0a-a49d-4a93-8d70-d1300b02c217 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:55.790719 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-45de2f0a-a49d-4a93-8d70-d1300b02c217 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:55.791202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-45de2f0a-a49d-4a93-8d70-d1300b02c217 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:55.791629 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-45de2f0a-a49d-4a93-8d70-d1300b02c217 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:55.927226 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-45de2f0a-a49d-4a93-8d70-d1300b02c217 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:55.935383 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-45de2f0a-a49d-4a93-8d70-d1300b02c217 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.158128 Aug 08 13:37:55.936115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 191/391] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:55 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:56.032729 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-90afbde6-8ce2-47db-86df-d10d89610e03 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:56.033617 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-90afbde6-8ce2-47db-86df-d10d89610e03 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:56.039885 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90afbde6-8ce2-47db-86df-d10d89610e03 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:56.040371 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90afbde6-8ce2-47db-86df-d10d89610e03 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:56.040788 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90afbde6-8ce2-47db-86df-d10d89610e03 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:56.041492 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90afbde6-8ce2-47db-86df-d10d89610e03 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:56.041980 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90afbde6-8ce2-47db-86df-d10d89610e03 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:56.042340 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90afbde6-8ce2-47db-86df-d10d89610e03 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:56.185369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-90afbde6-8ce2-47db-86df-d10d89610e03 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:56.193155 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-90afbde6-8ce2-47db-86df-d10d89610e03 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.164452 Aug 08 13:37:56.193728 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 201/392] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:56 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:56.956937 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d2519498-466e-40e7-98c9-7b2977675c4c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:56.957565 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d2519498-466e-40e7-98c9-7b2977675c4c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:56.964631 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d2519498-466e-40e7-98c9-7b2977675c4c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:56.965110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d2519498-466e-40e7-98c9-7b2977675c4c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:56.965537 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d2519498-466e-40e7-98c9-7b2977675c4c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:56.966233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d2519498-466e-40e7-98c9-7b2977675c4c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:56.966675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d2519498-466e-40e7-98c9-7b2977675c4c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:56.967096 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d2519498-466e-40e7-98c9-7b2977675c4c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:57.100774 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d2519498-466e-40e7-98c9-7b2977675c4c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:57.111578 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d2519498-466e-40e7-98c9-7b2977675c4c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.157945 Aug 08 13:37:57.112252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 192/393] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:56 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:57.214188 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-26ee1cc7-65d6-49bc-9670-0b5e2052778f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:57.214786 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-26ee1cc7-65d6-49bc-9670-0b5e2052778f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:57.224728 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ee1cc7-65d6-49bc-9670-0b5e2052778f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:57.225267 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ee1cc7-65d6-49bc-9670-0b5e2052778f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:57.225853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ee1cc7-65d6-49bc-9670-0b5e2052778f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:57.227023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ee1cc7-65d6-49bc-9670-0b5e2052778f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:57.227706 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ee1cc7-65d6-49bc-9670-0b5e2052778f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:57.228205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ee1cc7-65d6-49bc-9670-0b5e2052778f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:57.380507 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-26ee1cc7-65d6-49bc-9670-0b5e2052778f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:57.388402 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-26ee1cc7-65d6-49bc-9670-0b5e2052778f tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.178146 Aug 08 13:37:57.388966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 202/394] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:57 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:58.143940 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5181c480-beeb-47e5-9594-44c032c61f7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:58.144734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5181c480-beeb-47e5-9594-44c032c61f7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:58.151636 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5181c480-beeb-47e5-9594-44c032c61f7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:58.152113 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5181c480-beeb-47e5-9594-44c032c61f7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:58.152541 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5181c480-beeb-47e5-9594-44c032c61f7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:58.153229 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5181c480-beeb-47e5-9594-44c032c61f7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:58.153679 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5181c480-beeb-47e5-9594-44c032c61f7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:58.154097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5181c480-beeb-47e5-9594-44c032c61f7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:58.303272 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5181c480-beeb-47e5-9594-44c032c61f7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:58.311536 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5181c480-beeb-47e5-9594-44c032c61f7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.174226 Aug 08 13:37:58.312115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 193/395] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:58 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:58.409697 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-22669abb-f109-4644-af28-04da3518bb15 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:58.410330 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-22669abb-f109-4644-af28-04da3518bb15 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:58.417102 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-22669abb-f109-4644-af28-04da3518bb15 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:58.417592 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-22669abb-f109-4644-af28-04da3518bb15 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:58.418022 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-22669abb-f109-4644-af28-04da3518bb15 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:58.418726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-22669abb-f109-4644-af28-04da3518bb15 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:58.419205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-22669abb-f109-4644-af28-04da3518bb15 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:58.419637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-22669abb-f109-4644-af28-04da3518bb15 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:58.557081 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-22669abb-f109-4644-af28-04da3518bb15 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:58.568838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-22669abb-f109-4644-af28-04da3518bb15 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.162767 Aug 08 13:37:58.569852 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 203/396] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:58 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:59.333132 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-db8fc325-856c-4117-ab83-4ddfea73c907 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:59.333670 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-db8fc325-856c-4117-ab83-4ddfea73c907 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:59.340659 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-db8fc325-856c-4117-ab83-4ddfea73c907 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:59.341142 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-db8fc325-856c-4117-ab83-4ddfea73c907 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:59.341574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-db8fc325-856c-4117-ab83-4ddfea73c907 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:59.342260 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-db8fc325-856c-4117-ab83-4ddfea73c907 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:59.342708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-db8fc325-856c-4117-ab83-4ddfea73c907 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:59.343119 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-db8fc325-856c-4117-ab83-4ddfea73c907 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:59.484947 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-db8fc325-856c-4117-ab83-4ddfea73c907 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:59.494506 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-db8fc325-856c-4117-ab83-4ddfea73c907 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.165429 Aug 08 13:37:59.495089 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 194/397] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:59 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:37:59.593027 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4765d5ee-2175-4aa6-bc54-007f04045cc4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:37:59.593772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4765d5ee-2175-4aa6-bc54-007f04045cc4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:37:59.604260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4765d5ee-2175-4aa6-bc54-007f04045cc4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:59.604797 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4765d5ee-2175-4aa6-bc54-007f04045cc4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:59.605346 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4765d5ee-2175-4aa6-bc54-007f04045cc4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:59.606439 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4765d5ee-2175-4aa6-bc54-007f04045cc4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:37:59.607165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4765d5ee-2175-4aa6-bc54-007f04045cc4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:37:59.607830 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4765d5ee-2175-4aa6-bc54-007f04045cc4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:37:59.748898 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4765d5ee-2175-4aa6-bc54-007f04045cc4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:37:59.757258 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4765d5ee-2175-4aa6-bc54-007f04045cc4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.170290 Aug 08 13:37:59.757838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 204/398] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:37:59 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:00.516273 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-83ea6cf9-6903-49c7-b8f0-a2bbc9e7c780 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:00.516826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-83ea6cf9-6903-49c7-b8f0-a2bbc9e7c780 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:00.523911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83ea6cf9-6903-49c7-b8f0-a2bbc9e7c780 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:00.524390 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83ea6cf9-6903-49c7-b8f0-a2bbc9e7c780 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:00.524818 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83ea6cf9-6903-49c7-b8f0-a2bbc9e7c780 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:00.525492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83ea6cf9-6903-49c7-b8f0-a2bbc9e7c780 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:00.525940 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83ea6cf9-6903-49c7-b8f0-a2bbc9e7c780 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:00.526360 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83ea6cf9-6903-49c7-b8f0-a2bbc9e7c780 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:00.679474 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-83ea6cf9-6903-49c7-b8f0-a2bbc9e7c780 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:00.687452 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-83ea6cf9-6903-49c7-b8f0-a2bbc9e7c780 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.175099 Aug 08 13:38:00.688043 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 195/399] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:00 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:00.778724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1580ff55-23df-45e0-8158-42d6777431ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:00.779320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1580ff55-23df-45e0-8158-42d6777431ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:00.785760 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1580ff55-23df-45e0-8158-42d6777431ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:00.786243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1580ff55-23df-45e0-8158-42d6777431ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:00.786670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1580ff55-23df-45e0-8158-42d6777431ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:00.787406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1580ff55-23df-45e0-8158-42d6777431ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:00.787868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1580ff55-23df-45e0-8158-42d6777431ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:00.788286 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1580ff55-23df-45e0-8158-42d6777431ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:00.923580 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-1580ff55-23df-45e0-8158-42d6777431ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:00.932337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1580ff55-23df-45e0-8158-42d6777431ab tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.158026 Aug 08 13:38:00.932901 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 205/400] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:00 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:01.711990 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-666f7636-3952-4e03-be96-b6b681396b0b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:01.712927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-666f7636-3952-4e03-be96-b6b681396b0b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:01.720071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-666f7636-3952-4e03-be96-b6b681396b0b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:01.720694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-666f7636-3952-4e03-be96-b6b681396b0b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:01.721221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-666f7636-3952-4e03-be96-b6b681396b0b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:01.721967 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-666f7636-3952-4e03-be96-b6b681396b0b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:01.722526 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-666f7636-3952-4e03-be96-b6b681396b0b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:01.723154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-666f7636-3952-4e03-be96-b6b681396b0b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:01.870414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-666f7636-3952-4e03-be96-b6b681396b0b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:01.878939 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-666f7636-3952-4e03-be96-b6b681396b0b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.171811 Aug 08 13:38:01.879602 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 196/401] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:01 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:01.953664 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b61ec9c2-0556-4183-a37e-fbc94ca902fa tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:01.954294 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b61ec9c2-0556-4183-a37e-fbc94ca902fa tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:01.960752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b61ec9c2-0556-4183-a37e-fbc94ca902fa tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:01.961230 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b61ec9c2-0556-4183-a37e-fbc94ca902fa tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:01.961679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b61ec9c2-0556-4183-a37e-fbc94ca902fa tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:01.962338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b61ec9c2-0556-4183-a37e-fbc94ca902fa tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:01.962829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b61ec9c2-0556-4183-a37e-fbc94ca902fa tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:01.963287 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b61ec9c2-0556-4183-a37e-fbc94ca902fa tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:02.119337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b61ec9c2-0556-4183-a37e-fbc94ca902fa tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:02.130412 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b61ec9c2-0556-4183-a37e-fbc94ca902fa tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1313 microversion: 2.1 time: 0.180483 Aug 08 13:38:02.131530 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 206/402] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:01 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:02.910502 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-51b59562-370b-4214-b15f-f0d2829c738b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:02.911321 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-51b59562-370b-4214-b15f-f0d2829c738b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:02.920215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51b59562-370b-4214-b15f-f0d2829c738b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:02.920852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51b59562-370b-4214-b15f-f0d2829c738b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:02.921238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51b59562-370b-4214-b15f-f0d2829c738b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:02.921969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51b59562-370b-4214-b15f-f0d2829c738b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:02.922412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51b59562-370b-4214-b15f-f0d2829c738b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:02.922843 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51b59562-370b-4214-b15f-f0d2829c738b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:03.070319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-51b59562-370b-4214-b15f-f0d2829c738b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:03.080213 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-51b59562-370b-4214-b15f-f0d2829c738b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.173815 Aug 08 13:38:03.080984 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 197/403] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:02 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:03.164985 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9f9dedf8-f4ed-479c-aa4f-8487e352bf01 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:03.165590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9f9dedf8-f4ed-479c-aa4f-8487e352bf01 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:03.172200 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f9dedf8-f4ed-479c-aa4f-8487e352bf01 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:03.172649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f9dedf8-f4ed-479c-aa4f-8487e352bf01 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:03.173078 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f9dedf8-f4ed-479c-aa4f-8487e352bf01 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:03.173854 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f9dedf8-f4ed-479c-aa4f-8487e352bf01 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:03.174455 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f9dedf8-f4ed-479c-aa4f-8487e352bf01 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:03.174936 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f9dedf8-f4ed-479c-aa4f-8487e352bf01 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:03.347460 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9f9dedf8-f4ed-479c-aa4f-8487e352bf01 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:03.355946 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9f9dedf8-f4ed-479c-aa4f-8487e352bf01 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1496 microversion: 2.1 time: 0.194918 Aug 08 13:38:03.356557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 207/404] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:03 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1496 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:04.017449 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1671fcdd-5232-45c5-9aca-9f89df211d10 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:04.018245 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1671fcdd-5232-45c5-9aca-9f89df211d10 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:04.024948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1671fcdd-5232-45c5-9aca-9f89df211d10 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.025436 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1671fcdd-5232-45c5-9aca-9f89df211d10 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.025867 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1671fcdd-5232-45c5-9aca-9f89df211d10 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.026583 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1671fcdd-5232-45c5-9aca-9f89df211d10 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.027047 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1671fcdd-5232-45c5-9aca-9f89df211d10 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.027506 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1671fcdd-5232-45c5-9aca-9f89df211d10 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.055974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1671fcdd-5232-45c5-9aca-9f89df211d10 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:38:04.101093 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-34985f69-0a79-4866-90dd-1927eddb498e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:04.101715 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-34985f69-0a79-4866-90dd-1927eddb498e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:04.103797 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:38:04.113693 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-34985f69-0a79-4866-90dd-1927eddb498e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.120396 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-34985f69-0a79-4866-90dd-1927eddb498e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.121195 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-34985f69-0a79-4866-90dd-1927eddb498e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.122444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-34985f69-0a79-4866-90dd-1927eddb498e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.123316 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-34985f69-0a79-4866-90dd-1927eddb498e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.124088 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-34985f69-0a79-4866-90dd-1927eddb498e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.167396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1671fcdd-5232-45c5-9aca-9f89df211d10 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 204 len: 0 microversion: 2.1 time: 0.153749 Aug 08 13:38:04.168385 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 198/405] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:38:04 2022] DELETE /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:38:04.178952 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-39d96be5-3d1a-4457-829a-37b991c345d4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:04.179739 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-39d96be5-3d1a-4457-829a-37b991c345d4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:04.187637 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39d96be5-3d1a-4457-829a-37b991c345d4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.188128 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39d96be5-3d1a-4457-829a-37b991c345d4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.188549 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39d96be5-3d1a-4457-829a-37b991c345d4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.189444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39d96be5-3d1a-4457-829a-37b991c345d4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.190068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39d96be5-3d1a-4457-829a-37b991c345d4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.190480 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-39d96be5-3d1a-4457-829a-37b991c345d4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.391016 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-34985f69-0a79-4866-90dd-1927eddb498e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:04.398246 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-34985f69-0a79-4866-90dd-1927eddb498e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1500 microversion: 2.1 time: 0.300961 Aug 08 13:38:04.398834 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 208/406] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:04 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1500 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:38:04.423465 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c13f72e5-6051-49f6-8c2b-9955f2b49d7d"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:38:04.425951 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:04.434245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.434952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.435815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.436025 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-39d96be5-3d1a-4457-829a-37b991c345d4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:04.437418 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.438063 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.438675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.449570 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-39d96be5-3d1a-4457-829a-37b991c345d4 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1502 microversion: 2.1 time: 0.276216 Aug 08 13:38:04.451233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 199/407] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:04 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:04.466153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] HTTP exception thrown: Cannot 'attach_volume' instance ff259851-1c4f-411c-b555-ded6a785a91d while it is in vm_state rescued Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Request method failure captured: Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: POST /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d/os-volume_attachments HTTP/1.1 Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 74 Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REf1Ea14AYR1pE2a6K4N54fc0_x21TT0v6rOqtzgzhFTlqzH2mLPOhcT2JRzQ__W3s8-mQbJ-2jCAvD7htLjrZXdatV8tQuLIFbwXboRqq9yI-tUt4OQZMNTlEmgJXenIgfvcMxbcNgSLDSG6kCzX_3jRFF8WtZW-BF7nLZaWhtqiA Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: f90db8c721374e0fb3a037661b3d9fe0 Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:38:04.467947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f90db8c721374e0fb3a037661b3d9fe0"}]}] Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: f90db8c721374e0fb3a037661b3d9fe0 Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-ServerRescueNegativeTestJSON-1645977264-project Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: 518d6948777944fd8214dc6d778a9a02 Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1645977264-project Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {"volumeAttachment": {"volumeId": "c13f72e5-6051-49f6-8c2b-9955f2b49d7d"}} Aug 08 13:38:04.469165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Cannot 'attach_volume' instance ff259851-1c4f-411c-b555-ded6a785a91d while it is in vm_state rescued Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'server_id': 'ff259851-1c4f-411c-b555-ded6a785a91d', 'body': {'volumeAttachment': {'volumeId': 'c13f72e5-6051-49f6-8c2b-9955f2b49d7d'}}} Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff259851-1c4f-411c-b555-ded6a785a91d in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:38:04.469911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ff259851-1c4f-411c-b555-ded6a785a91d while it is in vm_state rescued Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:38:04.471343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:38:04.472444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:38:04.472444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:38:04.472444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ff259851-1c4f-411c-b555-ded6a785a91d while it is in vm_state rescued Aug 08 13:38:04.472444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:38:04.472444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Returning 409 to user: Cannot 'attach_volume' instance ff259851-1c4f-411c-b555-ded6a785a91d while it is in vm_state rescued {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:38:04.472444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-67fc5469-e8ff-4c67-b965-81afc86f7a4b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050457 Aug 08 13:38:04.472444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 209/408] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:38:04 2022] POST /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 08 13:38:04.479334 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-88ffa67c-92f3-4562-8db1-e5191f461ce7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:38:04.479863 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-88ffa67c-92f3-4562-8db1-e5191f461ce7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:04.486645 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ffa67c-92f3-4562-8db1-e5191f461ce7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.487433 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ffa67c-92f3-4562-8db1-e5191f461ce7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.487583 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ffa67c-92f3-4562-8db1-e5191f461ce7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.488377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ffa67c-92f3-4562-8db1-e5191f461ce7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.488784 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ffa67c-92f3-4562-8db1-e5191f461ce7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.489203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ffa67c-92f3-4562-8db1-e5191f461ce7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.517771 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:38:04.565124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-88ffa67c-92f3-4562-8db1-e5191f461ce7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d/action" status: 202 len: 0 microversion: 2.1 time: 0.089115 Aug 08 13:38:04.570495 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 200/409] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:38:04 2022] POST /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 13:38:04.576084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2910d7cc-7ecb-4b37-a55e-2c089b5592c3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:04.576684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2910d7cc-7ecb-4b37-a55e-2c089b5592c3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:04.583159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2910d7cc-7ecb-4b37-a55e-2c089b5592c3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.583637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2910d7cc-7ecb-4b37-a55e-2c089b5592c3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.584060 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2910d7cc-7ecb-4b37-a55e-2c089b5592c3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.584770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2910d7cc-7ecb-4b37-a55e-2c089b5592c3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:04.585209 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2910d7cc-7ecb-4b37-a55e-2c089b5592c3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:04.585623 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2910d7cc-7ecb-4b37-a55e-2c089b5592c3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:04.738846 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2910d7cc-7ecb-4b37-a55e-2c089b5592c3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:04.757416 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2910d7cc-7ecb-4b37-a55e-2c089b5592c3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1508 microversion: 2.1 time: 0.185375 Aug 08 13:38:04.758008 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 210/410] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:04 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:05.480431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3ddadd28-a32f-4120-be25-d71190443ca8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:05.481295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3ddadd28-a32f-4120-be25-d71190443ca8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:05.493206 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ddadd28-a32f-4120-be25-d71190443ca8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:05.494477 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ddadd28-a32f-4120-be25-d71190443ca8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:05.495232 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ddadd28-a32f-4120-be25-d71190443ca8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:05.496699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ddadd28-a32f-4120-be25-d71190443ca8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:05.497756 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ddadd28-a32f-4120-be25-d71190443ca8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:05.498517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ddadd28-a32f-4120-be25-d71190443ca8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:05.787017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-88faac1b-1001-4e02-bf63-eccad352c955 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:05.787808 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-88faac1b-1001-4e02-bf63-eccad352c955 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:05.798771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-88faac1b-1001-4e02-bf63-eccad352c955 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:05.799112 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-88faac1b-1001-4e02-bf63-eccad352c955 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:05.799560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-88faac1b-1001-4e02-bf63-eccad352c955 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:05.800306 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-88faac1b-1001-4e02-bf63-eccad352c955 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:05.800766 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-88faac1b-1001-4e02-bf63-eccad352c955 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:05.801185 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-88faac1b-1001-4e02-bf63-eccad352c955 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:05.866606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3ddadd28-a32f-4120-be25-d71190443ca8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:05.884010 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3ddadd28-a32f-4120-be25-d71190443ca8 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1502 microversion: 2.1 time: 0.409865 Aug 08 13:38:05.886277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 201/411] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:05 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1502 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:06.110613 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-88faac1b-1001-4e02-bf63-eccad352c955 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:06.120415 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-88faac1b-1001-4e02-bf63-eccad352c955 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1508 microversion: 2.1 time: 0.337747 Aug 08 13:38:06.121107 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 211/412] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:05 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1508 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:38:06.805428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-17b88e39-3a0d-42b2-af7f-f5fbf05cf352 req-747239f3-3241-4f22-97bc-dd0654ca8777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe7838c-1f9e-47bd-a585-149d2ca62fc1", "name": "network-vif-deleted", "tag": "6a33552b-46f9-4df5-94de-6f13339df1e9"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:38:06.825968 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-17b88e39-3a0d-42b2-af7f-f5fbf05cf352 req-747239f3-3241-4f22-97bc-dd0654ca8777 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:06.827163 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-17b88e39-3a0d-42b2-af7f-f5fbf05cf352 req-747239f3-3241-4f22-97bc-dd0654ca8777 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:06.828435 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-17b88e39-3a0d-42b2-af7f-f5fbf05cf352 req-747239f3-3241-4f22-97bc-dd0654ca8777 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:06.856163 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-17b88e39-3a0d-42b2-af7f-f5fbf05cf352 req-747239f3-3241-4f22-97bc-dd0654ca8777 service nova] Creating event network-vif-deleted:6a33552b-46f9-4df5-94de-6f13339df1e9 for instance 4fe7838c-1f9e-47bd-a585-149d2ca62fc1 on hv-cinder-85199 Aug 08 13:38:06.865402 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-17b88e39-3a0d-42b2-af7f-f5fbf05cf352 req-747239f3-3241-4f22-97bc-dd0654ca8777 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066141 Aug 08 13:38:06.866970 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 202/413] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:38:06.916649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e832b46f-df98-4885-b8e1-11e47e027225 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:06.917632 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e832b46f-df98-4885-b8e1-11e47e027225 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:06.923806 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e832b46f-df98-4885-b8e1-11e47e027225 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:06.924277 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e832b46f-df98-4885-b8e1-11e47e027225 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:06.924892 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e832b46f-df98-4885-b8e1-11e47e027225 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:06.926006 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e832b46f-df98-4885-b8e1-11e47e027225 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:06.926599 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e832b46f-df98-4885-b8e1-11e47e027225 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:06.927303 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e832b46f-df98-4885-b8e1-11e47e027225 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:07.005859 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e832b46f-df98-4885-b8e1-11e47e027225 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:07.020841 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e832b46f-df98-4885-b8e1-11e47e027225 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1298 microversion: 2.1 time: 0.107923 Aug 08 13:38:07.021871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 212/414] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:06 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:07.146117 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c7fd10f9-df83-42ec-ae90-bcd3a6f4182f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:07.146824 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c7fd10f9-df83-42ec-ae90-bcd3a6f4182f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:07.153331 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7fd10f9-df83-42ec-ae90-bcd3a6f4182f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:07.153824 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7fd10f9-df83-42ec-ae90-bcd3a6f4182f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:07.154256 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7fd10f9-df83-42ec-ae90-bcd3a6f4182f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:07.155002 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7fd10f9-df83-42ec-ae90-bcd3a6f4182f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:07.155464 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7fd10f9-df83-42ec-ae90-bcd3a6f4182f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:07.155888 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7fd10f9-df83-42ec-ae90-bcd3a6f4182f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:07.330172 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c7fd10f9-df83-42ec-ae90-bcd3a6f4182f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:07.342798 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c7fd10f9-df83-42ec-ae90-bcd3a6f4182f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1508 microversion: 2.1 time: 0.200901 Aug 08 13:38:07.344348 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 203/415] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:07 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:08.050756 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b2ab5285-737b-4a32-ad68-514e359fe343 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:08.051861 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b2ab5285-737b-4a32-ad68-514e359fe343 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:08.061525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b2ab5285-737b-4a32-ad68-514e359fe343 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:08.062320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b2ab5285-737b-4a32-ad68-514e359fe343 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:08.062985 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b2ab5285-737b-4a32-ad68-514e359fe343 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:08.064156 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b2ab5285-737b-4a32-ad68-514e359fe343 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:08.064909 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b2ab5285-737b-4a32-ad68-514e359fe343 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:08.065614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b2ab5285-737b-4a32-ad68-514e359fe343 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:08.140354 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b2ab5285-737b-4a32-ad68-514e359fe343 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:08.149479 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b2ab5285-737b-4a32-ad68-514e359fe343 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1298 microversion: 2.1 time: 0.103678 Aug 08 13:38:08.150099 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 213/416] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:08 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:08.378396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-942d4d5b-032c-492b-9f82-de60acbc7f82 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:08.379200 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-942d4d5b-032c-492b-9f82-de60acbc7f82 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:08.388540 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942d4d5b-032c-492b-9f82-de60acbc7f82 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:08.389328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942d4d5b-032c-492b-9f82-de60acbc7f82 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:08.390022 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942d4d5b-032c-492b-9f82-de60acbc7f82 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:08.391271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942d4d5b-032c-492b-9f82-de60acbc7f82 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:08.392038 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942d4d5b-032c-492b-9f82-de60acbc7f82 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:08.392603 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942d4d5b-032c-492b-9f82-de60acbc7f82 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:08.576093 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-942d4d5b-032c-492b-9f82-de60acbc7f82 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:08.586064 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-942d4d5b-032c-492b-9f82-de60acbc7f82 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1508 microversion: 2.1 time: 0.216069 Aug 08 13:38:08.587241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 204/417] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:08 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:09.172662 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-cfb985b8-5a13-429f-b91f-5af4a23a548d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:09.174035 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-cfb985b8-5a13-429f-b91f-5af4a23a548d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:09.186826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cfb985b8-5a13-429f-b91f-5af4a23a548d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:09.188480 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cfb985b8-5a13-429f-b91f-5af4a23a548d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:09.189882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cfb985b8-5a13-429f-b91f-5af4a23a548d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:09.191506 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cfb985b8-5a13-429f-b91f-5af4a23a548d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:09.192563 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cfb985b8-5a13-429f-b91f-5af4a23a548d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:09.193641 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cfb985b8-5a13-429f-b91f-5af4a23a548d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:09.199172 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:38:09.283112 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-cfb985b8-5a13-429f-b91f-5af4a23a548d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:09.291830 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-cfb985b8-5a13-429f-b91f-5af4a23a548d tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1298 microversion: 2.1 time: 0.125732 Aug 08 13:38:09.292428 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 214/418] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:09 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:09.610604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d85c5ba0-bfd3-44e8-b877-8b2202ec97eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:09.611756 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d85c5ba0-bfd3-44e8-b877-8b2202ec97eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:09.619310 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d85c5ba0-bfd3-44e8-b877-8b2202ec97eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:09.619810 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d85c5ba0-bfd3-44e8-b877-8b2202ec97eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:09.620252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d85c5ba0-bfd3-44e8-b877-8b2202ec97eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:09.620986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d85c5ba0-bfd3-44e8-b877-8b2202ec97eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:09.621426 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d85c5ba0-bfd3-44e8-b877-8b2202ec97eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:09.621884 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d85c5ba0-bfd3-44e8-b877-8b2202ec97eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:09.766936 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d85c5ba0-bfd3-44e8-b877-8b2202ec97eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:09.775278 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d85c5ba0-bfd3-44e8-b877-8b2202ec97eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1508 microversion: 2.1 time: 0.168841 Aug 08 13:38:09.775881 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 205/419] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:09 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:10.315341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:10.316475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:10.325813 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:10.326459 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:10.327131 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:10.328144 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:10.328696 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:10.329321 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:10.367770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:10.368353 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:10.368850 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:10.369343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lazy-loading 'fault' on Instance uuid 4fe7838c-1f9e-47bd-a585-149d2ca62fc1 {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:38:10.423242 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8f3afb4bf040c58feb266b45c0f503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830ccc10c7284fc2942b49cd091e942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:10.431977 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0c3d747d-d8eb-4a55-8936-ffb11f68f98e tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 200 len: 1303 microversion: 2.1 time: 0.122094 Aug 08 13:38:10.432719 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 215/420] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:10 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:38:10.797509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-01ab18ab-42d9-4a3c-8840-98fa4392c2dc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:10.798136 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-01ab18ab-42d9-4a3c-8840-98fa4392c2dc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:10.805568 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-01ab18ab-42d9-4a3c-8840-98fa4392c2dc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:10.806049 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-01ab18ab-42d9-4a3c-8840-98fa4392c2dc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:10.806490 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-01ab18ab-42d9-4a3c-8840-98fa4392c2dc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:10.807265 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-01ab18ab-42d9-4a3c-8840-98fa4392c2dc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:10.807702 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-01ab18ab-42d9-4a3c-8840-98fa4392c2dc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:10.808129 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-01ab18ab-42d9-4a3c-8840-98fa4392c2dc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:10.958518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-01ab18ab-42d9-4a3c-8840-98fa4392c2dc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:10.966829 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-01ab18ab-42d9-4a3c-8840-98fa4392c2dc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1508 microversion: 2.1 time: 0.173531 Aug 08 13:38:10.967450 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 206/421] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:10 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:11.454712 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:11.455376 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] [instance: 4fe7838c-1f9e-47bd-a585-149d2ca62fc1] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:11.462061 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:11.462554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:11.462983 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:11.463743 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:11.464194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:11.464614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:11.481084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] HTTP exception thrown: Instance 4fe7838c-1f9e-47bd-a585-149d2ca62fc1 could not be found. Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Request method failure captured: Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 HTTP/1.1 Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8RFj3E7qttLdHfrg7HM6xNhXYhhTgGPHVBcPA3hYFEzi7idxgfKiW1mLTunOoJDvJipFqqXDupLs-OOmPfIcZFIWOryqtSjmv8nCfwxkZpzrUho2EwqTrzZU2yUznYhhhpGmmqgvfC-LpJ-xG91Vnwxu86JhwC5aO8iMf8sFxUu-EYs Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 830ccc10c7284fc2942b49cd091e942a Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-VolumesActionsTest-938170610 Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:38:11.482675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/830ccc10c7284fc2942b49cd091e942a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_830ccc10c7284fc2942b49cd091e942a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/830ccc10c7284fc2942b49cd091e942a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/830ccc10c7284fc2942b49cd091e942a"}]}] Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-VolumesActionsTest-938170610 Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 830ccc10c7284fc2942b49cd091e942a Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-VolumesActionsTest-938170610 Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-VolumesActionsTest-938170610-project Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: bd8f3afb4bf040c58feb266b45c0f503 Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-VolumesActionsTest-938170610-project Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 4fe7838c-1f9e-47bd-a585-149d2ca62fc1 could not be found. Aug 08 13:38:11.484897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '4fe7838c-1f9e-47bd-a585-149d2ca62fc1'} Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fe7838c-1f9e-47bd-a585-149d2ca62fc1 could not be found. Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:38:11.486072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fe7838c-1f9e-47bd-a585-149d2ca62fc1 could not be found. Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fe7838c-1f9e-47bd-a585-149d2ca62fc1 could not be found. Aug 08 13:38:11.487448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:38:11.488766 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] Returning 404 to user: Instance 4fe7838c-1f9e-47bd-a585-149d2ca62fc1 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:38:11.488766 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d64290a8-5e12-4c18-a7a5-d20b97a52557 tempest-VolumesActionsTest-938170610 tempest-VolumesActionsTest-938170610-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1" status: 404 len: 111 microversion: 2.1 time: 0.033834 Aug 08 13:38:11.488766 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 216/422] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:11 2022] GET /compute/v2.1/servers/4fe7838c-1f9e-47bd-a585-149d2ca62fc1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:38:11.989392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4f0c79e3-2993-49ff-b478-d4088fae8541 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:11.990082 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4f0c79e3-2993-49ff-b478-d4088fae8541 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:11.998155 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f0c79e3-2993-49ff-b478-d4088fae8541 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:11.999035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f0c79e3-2993-49ff-b478-d4088fae8541 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:11.999779 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f0c79e3-2993-49ff-b478-d4088fae8541 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:12.000957 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f0c79e3-2993-49ff-b478-d4088fae8541 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:12.001663 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f0c79e3-2993-49ff-b478-d4088fae8541 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:12.002380 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f0c79e3-2993-49ff-b478-d4088fae8541 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:12.218422 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4f0c79e3-2993-49ff-b478-d4088fae8541 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:12.231985 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4f0c79e3-2993-49ff-b478-d4088fae8541 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1508 microversion: 2.1 time: 0.246426 Aug 08 13:38:12.233255 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 207/423] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:11 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:13.269046 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c00282e4-5bc2-4799-9369-5e5c66003c69 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:13.270270 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c00282e4-5bc2-4799-9369-5e5c66003c69 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:13.281092 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c00282e4-5bc2-4799-9369-5e5c66003c69 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:13.281919 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c00282e4-5bc2-4799-9369-5e5c66003c69 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:13.282678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c00282e4-5bc2-4799-9369-5e5c66003c69 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:13.283967 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c00282e4-5bc2-4799-9369-5e5c66003c69 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:13.284840 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c00282e4-5bc2-4799-9369-5e5c66003c69 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:13.285556 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c00282e4-5bc2-4799-9369-5e5c66003c69 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:13.458130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c00282e4-5bc2-4799-9369-5e5c66003c69 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:13.466527 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c00282e4-5bc2-4799-9369-5e5c66003c69 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1508 microversion: 2.1 time: 0.204904 Aug 08 13:38:13.467242 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 217/424] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:13 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:14.489546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9bb6df06-bd27-4f15-8d6b-9b75fba9aad7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:14.490344 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9bb6df06-bd27-4f15-8d6b-9b75fba9aad7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:14.499358 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bb6df06-bd27-4f15-8d6b-9b75fba9aad7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:14.499861 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bb6df06-bd27-4f15-8d6b-9b75fba9aad7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:14.500329 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bb6df06-bd27-4f15-8d6b-9b75fba9aad7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:14.501133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bb6df06-bd27-4f15-8d6b-9b75fba9aad7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:14.501711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bb6df06-bd27-4f15-8d6b-9b75fba9aad7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:14.502292 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9bb6df06-bd27-4f15-8d6b-9b75fba9aad7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:14.652002 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9bb6df06-bd27-4f15-8d6b-9b75fba9aad7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:14.663862 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9bb6df06-bd27-4f15-8d6b-9b75fba9aad7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1514 microversion: 2.1 time: 0.178757 Aug 08 13:38:14.664670 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 208/425] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:14 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:23.530699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-56cb1c9d-4a72-421f-8887-a63574b632b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'create', calling method: .version_select at 0x7f7d24e3a040>, body: {"keypair": {"name": "tempest-keypair-1037712942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeEiCIDikGehcVCYpqFwDI4mJgSTvvVzt9p//SU7qws5ALFQN1bhSyn9oVDLHlPiTc6MZLa7eP3+GyNiX6wAU1h1P3hXV/qbcw2HpX/iihZf7sKqt8h2NLtbsEYyEJecA=="}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:38:23.542043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=21 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:38:23.542951 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=21 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:38:23.557006 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-56cb1c9d-4a72-421f-8887-a63574b632b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Getting quotas for project f90db8c721374e0fb3a037661b3d9fe0. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:38:23.565682 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-56cb1c9d-4a72-421f-8887-a63574b632b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Getting quotas for user 518d6948777944fd8214dc6d778a9a02 and project f90db8c721374e0fb3a037661b3d9fe0. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:38:23.617156 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-56cb1c9d-4a72-421f-8887-a63574b632b7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091603 Aug 08 13:38:23.620262 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 218/426] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 13:38:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:38:26.344986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-463242822", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2d7ae95-a7a1-43c7-a098-10d1941cdbb9"}], "security_groups": [{"name": "tempest-securitygroup--568738796"}], "key_name": "tempest-keypair-1037712942", "user_data": "}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:38:26.356496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:38:26.357581 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:38:26.480045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] validate_networks() for [('b2d7ae95-a7a1-43c7-a098-10d1941cdbb9', None, None, None, None, None)] {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:38:27.036271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:38:27.037485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:38:27.038382 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:38:27.039025 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:38:27.039889 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:38:27.065651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:27.066672 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:27.068377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:27.070015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:27.070968 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:27.071738 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:27.109493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Getting quotas for project f90db8c721374e0fb3a037661b3d9fe0. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:38:27.117879 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Getting quotas for user 518d6948777944fd8214dc6d778a9a02 and project f90db8c721374e0fb3a037661b3d9fe0. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:38:27.139045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:38:27.144127 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:38:27.232129 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a74d4d85-9120-4858-aa06-e704345adad3 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.891162 Aug 08 13:38:27.233217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 209/427] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:38:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:38:27.245661 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1ed86b72-6b82-48e9-9c94-14dd68f3bae2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:27.247342 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1ed86b72-6b82-48e9-9c94-14dd68f3bae2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:27.354727 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-1ed86b72-6b82-48e9-9c94-14dd68f3bae2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:27.364504 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1ed86b72-6b82-48e9-9c94-14dd68f3bae2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1245 microversion: 2.1 time: 0.123048 Aug 08 13:38:27.365347 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 219/428] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:27 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:38:28.393493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c08df104-f989-4069-a138-e27cef5b20b6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:28.395983 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c08df104-f989-4069-a138-e27cef5b20b6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:28.419055 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c08df104-f989-4069-a138-e27cef5b20b6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:28.419627 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c08df104-f989-4069-a138-e27cef5b20b6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:28.421112 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c08df104-f989-4069-a138-e27cef5b20b6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:28.421112 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c08df104-f989-4069-a138-e27cef5b20b6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:28.431456 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c08df104-f989-4069-a138-e27cef5b20b6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:28.432419 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c08df104-f989-4069-a138-e27cef5b20b6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:28.543601 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c08df104-f989-4069-a138-e27cef5b20b6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:28.551583 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c08df104-f989-4069-a138-e27cef5b20b6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1249 microversion: 2.1 time: 0.162399 Aug 08 13:38:28.552288 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 210/429] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:28 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1249 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:29.581228 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ac5a47e0-742d-47c8-9c16-b60a7429b560 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:29.582223 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ac5a47e0-742d-47c8-9c16-b60a7429b560 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:29.601554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac5a47e0-742d-47c8-9c16-b60a7429b560 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:29.602351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac5a47e0-742d-47c8-9c16-b60a7429b560 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:29.603010 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac5a47e0-742d-47c8-9c16-b60a7429b560 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:29.604216 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac5a47e0-742d-47c8-9c16-b60a7429b560 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:29.604936 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac5a47e0-742d-47c8-9c16-b60a7429b560 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:29.614394 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ac5a47e0-742d-47c8-9c16-b60a7429b560 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:29.725441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ac5a47e0-742d-47c8-9c16-b60a7429b560 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:29.746832 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ac5a47e0-742d-47c8-9c16-b60a7429b560 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1249 microversion: 2.1 time: 0.172495 Aug 08 13:38:29.755718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 220/430] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:29 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1249 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:30.776568 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-132ef137-81e8-4747-9ee8-79fc564956ce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:30.777263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-132ef137-81e8-4747-9ee8-79fc564956ce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:30.798850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-132ef137-81e8-4747-9ee8-79fc564956ce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:30.799350 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-132ef137-81e8-4747-9ee8-79fc564956ce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:30.800031 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-132ef137-81e8-4747-9ee8-79fc564956ce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:30.800729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-132ef137-81e8-4747-9ee8-79fc564956ce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:30.801194 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-132ef137-81e8-4747-9ee8-79fc564956ce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:30.801612 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-132ef137-81e8-4747-9ee8-79fc564956ce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:30.887861 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-132ef137-81e8-4747-9ee8-79fc564956ce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:30.899934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-132ef137-81e8-4747-9ee8-79fc564956ce tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1297 microversion: 2.1 time: 0.132677 Aug 08 13:38:30.900594 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 211/431] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:30 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1297 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:31.926004 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-81fbd613-6dd6-40b4-b6df-35de5019a849 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:31.927414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-81fbd613-6dd6-40b4-b6df-35de5019a849 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:31.945988 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81fbd613-6dd6-40b4-b6df-35de5019a849 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:31.957058 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81fbd613-6dd6-40b4-b6df-35de5019a849 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:31.957822 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81fbd613-6dd6-40b4-b6df-35de5019a849 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:31.958587 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81fbd613-6dd6-40b4-b6df-35de5019a849 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:31.959051 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81fbd613-6dd6-40b4-b6df-35de5019a849 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:31.959538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81fbd613-6dd6-40b4-b6df-35de5019a849 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:32.106225 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-81fbd613-6dd6-40b4-b6df-35de5019a849 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:32.124201 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-81fbd613-6dd6-40b4-b6df-35de5019a849 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1303 microversion: 2.1 time: 0.200409 Aug 08 13:38:32.127906 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 221/432] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:31 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1303 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:33.157241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3f2ab997-a43e-4b2c-a5ec-40fec5e2f161 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:33.161685 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3f2ab997-a43e-4b2c-a5ec-40fec5e2f161 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:33.180681 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3f2ab997-a43e-4b2c-a5ec-40fec5e2f161 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:33.182828 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3f2ab997-a43e-4b2c-a5ec-40fec5e2f161 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:33.183521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3f2ab997-a43e-4b2c-a5ec-40fec5e2f161 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:33.187045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3f2ab997-a43e-4b2c-a5ec-40fec5e2f161 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:33.187571 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3f2ab997-a43e-4b2c-a5ec-40fec5e2f161 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:33.190249 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3f2ab997-a43e-4b2c-a5ec-40fec5e2f161 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:33.205216 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-cb8bc5b9-8883-4754-b704-76b164c38238 req-8e0b6713-deb9-4451-9831-1cf6bb59088f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f52d43d-f702-4083-8da1-ace76450a04d", "tag": "d64f2955-ff2d-41e6-bb65-c24de3c861ef"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:38:33.228910 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-cb8bc5b9-8883-4754-b704-76b164c38238 req-8e0b6713-deb9-4451-9831-1cf6bb59088f service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:33.230113 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-cb8bc5b9-8883-4754-b704-76b164c38238 req-8e0b6713-deb9-4451-9831-1cf6bb59088f service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:33.230781 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-cb8bc5b9-8883-4754-b704-76b164c38238 req-8e0b6713-deb9-4451-9831-1cf6bb59088f service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:33.256362 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-cb8bc5b9-8883-4754-b704-76b164c38238 req-8e0b6713-deb9-4451-9831-1cf6bb59088f service nova] Creating event network-changed:d64f2955-ff2d-41e6-bb65-c24de3c861ef for instance 5f52d43d-f702-4083-8da1-ace76450a04d on hv-cinder-85199 Aug 08 13:38:33.261646 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-cb8bc5b9-8883-4754-b704-76b164c38238 req-8e0b6713-deb9-4451-9831-1cf6bb59088f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060892 Aug 08 13:38:33.267986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 222/433] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:38:33.402477 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3f2ab997-a43e-4b2c-a5ec-40fec5e2f161 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:33.417701 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3f2ab997-a43e-4b2c-a5ec-40fec5e2f161 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.273506 Aug 08 13:38:33.418648 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 212/434] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:33 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:34.441316 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0324b35b-166a-425d-8463-0b75e6c07cd2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:34.442038 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0324b35b-166a-425d-8463-0b75e6c07cd2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:34.450833 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0324b35b-166a-425d-8463-0b75e6c07cd2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:34.453493 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0324b35b-166a-425d-8463-0b75e6c07cd2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:34.454112 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0324b35b-166a-425d-8463-0b75e6c07cd2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:34.455067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0324b35b-166a-425d-8463-0b75e6c07cd2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:34.455504 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0324b35b-166a-425d-8463-0b75e6c07cd2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:34.456084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0324b35b-166a-425d-8463-0b75e6c07cd2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:34.613628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0324b35b-166a-425d-8463-0b75e6c07cd2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:34.622723 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0324b35b-166a-425d-8463-0b75e6c07cd2 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.185822 Aug 08 13:38:34.623380 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 223/435] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:34 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:35.649934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-bc38343c-0ee5-4f9c-b52e-23048d4cee70 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:35.650596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-bc38343c-0ee5-4f9c-b52e-23048d4cee70 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:35.657646 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bc38343c-0ee5-4f9c-b52e-23048d4cee70 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:35.658250 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bc38343c-0ee5-4f9c-b52e-23048d4cee70 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:35.658686 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bc38343c-0ee5-4f9c-b52e-23048d4cee70 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:35.659454 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bc38343c-0ee5-4f9c-b52e-23048d4cee70 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:35.660084 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bc38343c-0ee5-4f9c-b52e-23048d4cee70 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:35.660330 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bc38343c-0ee5-4f9c-b52e-23048d4cee70 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:35.842128 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-bc38343c-0ee5-4f9c-b52e-23048d4cee70 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:35.857370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-bc38343c-0ee5-4f9c-b52e-23048d4cee70 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.211249 Aug 08 13:38:35.858419 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 213/436] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:35 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:36.885608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c4cedd3a-e13d-4fb8-af98-36c21e22df7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:36.887767 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c4cedd3a-e13d-4fb8-af98-36c21e22df7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:36.906816 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4cedd3a-e13d-4fb8-af98-36c21e22df7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:36.909259 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4cedd3a-e13d-4fb8-af98-36c21e22df7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:36.910263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4cedd3a-e13d-4fb8-af98-36c21e22df7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:36.911761 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4cedd3a-e13d-4fb8-af98-36c21e22df7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:36.913124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4cedd3a-e13d-4fb8-af98-36c21e22df7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:36.914167 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4cedd3a-e13d-4fb8-af98-36c21e22df7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:37.185691 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c4cedd3a-e13d-4fb8-af98-36c21e22df7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:37.220254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c4cedd3a-e13d-4fb8-af98-36c21e22df7f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.341804 Aug 08 13:38:37.222184 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 224/437] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:36 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:38.261520 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e4f4e501-a878-4a39-9e27-6aaa6a13afb4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:38.262167 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e4f4e501-a878-4a39-9e27-6aaa6a13afb4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:38.272449 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:38:38.276199 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:38:38.283045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4f4e501-a878-4a39-9e27-6aaa6a13afb4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:38.284105 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4f4e501-a878-4a39-9e27-6aaa6a13afb4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:38.285739 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4f4e501-a878-4a39-9e27-6aaa6a13afb4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:38.287056 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4f4e501-a878-4a39-9e27-6aaa6a13afb4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:38.288190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4f4e501-a878-4a39-9e27-6aaa6a13afb4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:38.289109 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e4f4e501-a878-4a39-9e27-6aaa6a13afb4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:38.518492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e4f4e501-a878-4a39-9e27-6aaa6a13afb4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:38.527916 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e4f4e501-a878-4a39-9e27-6aaa6a13afb4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.270432 Aug 08 13:38:38.533166 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 214/438] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:38 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:39.554602 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0f8b3b03-ea04-48fc-924f-32f0f372e707 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:39.562597 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0f8b3b03-ea04-48fc-924f-32f0f372e707 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:39.564930 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:38:39.580169 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0f8b3b03-ea04-48fc-924f-32f0f372e707 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:39.580684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0f8b3b03-ea04-48fc-924f-32f0f372e707 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:39.581126 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0f8b3b03-ea04-48fc-924f-32f0f372e707 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:39.581850 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0f8b3b03-ea04-48fc-924f-32f0f372e707 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:39.582343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0f8b3b03-ea04-48fc-924f-32f0f372e707 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:39.582770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0f8b3b03-ea04-48fc-924f-32f0f372e707 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:39.775243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0f8b3b03-ea04-48fc-924f-32f0f372e707 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:39.788050 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0f8b3b03-ea04-48fc-924f-32f0f372e707 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.238402 Aug 08 13:38:39.790164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 225/439] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:39 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:40.811942 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4675a0fc-d050-4e9d-a607-4260546f729e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:40.812636 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4675a0fc-d050-4e9d-a607-4260546f729e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:40.820161 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4675a0fc-d050-4e9d-a607-4260546f729e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:40.820655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4675a0fc-d050-4e9d-a607-4260546f729e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:40.821086 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4675a0fc-d050-4e9d-a607-4260546f729e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:40.821811 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4675a0fc-d050-4e9d-a607-4260546f729e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:40.822263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4675a0fc-d050-4e9d-a607-4260546f729e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:40.822677 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4675a0fc-d050-4e9d-a607-4260546f729e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:40.859441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-7dbb0ac3-cd57-4406-9cb2-99fd3d66ebda req-2c366bab-42b6-42bb-8d31-160e45be3eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f52d43d-f702-4083-8da1-ace76450a04d", "name": "network-vif-plugged", "status": "completed", "tag": "d64f2955-ff2d-41e6-bb65-c24de3c861ef"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:38:40.877806 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7dbb0ac3-cd57-4406-9cb2-99fd3d66ebda req-2c366bab-42b6-42bb-8d31-160e45be3eb6 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:40.878697 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7dbb0ac3-cd57-4406-9cb2-99fd3d66ebda req-2c366bab-42b6-42bb-8d31-160e45be3eb6 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:40.879408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7dbb0ac3-cd57-4406-9cb2-99fd3d66ebda req-2c366bab-42b6-42bb-8d31-160e45be3eb6 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:40.892429 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-7dbb0ac3-cd57-4406-9cb2-99fd3d66ebda req-2c366bab-42b6-42bb-8d31-160e45be3eb6 service nova] Creating event network-vif-plugged:d64f2955-ff2d-41e6-bb65-c24de3c861ef for instance 5f52d43d-f702-4083-8da1-ace76450a04d on hv-cinder-85199 Aug 08 13:38:40.900971 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-7dbb0ac3-cd57-4406-9cb2-99fd3d66ebda req-2c366bab-42b6-42bb-8d31-160e45be3eb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045491 Aug 08 13:38:40.902297 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 226/440] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:38:40.988796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4675a0fc-d050-4e9d-a607-4260546f729e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:40.996794 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4675a0fc-d050-4e9d-a607-4260546f729e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.188921 Aug 08 13:38:40.997693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 215/441] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:40 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:42.020185 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-71041964-8b30-4965-8160-f14350447c07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:42.020887 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-71041964-8b30-4965-8160-f14350447c07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:42.027641 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-71041964-8b30-4965-8160-f14350447c07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:42.028133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-71041964-8b30-4965-8160-f14350447c07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:42.028569 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-71041964-8b30-4965-8160-f14350447c07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:42.029284 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-71041964-8b30-4965-8160-f14350447c07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:42.029721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-71041964-8b30-4965-8160-f14350447c07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:42.030154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-71041964-8b30-4965-8160-f14350447c07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:42.176000 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-71041964-8b30-4965-8160-f14350447c07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:42.184622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-71041964-8b30-4965-8160-f14350447c07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.168869 Aug 08 13:38:42.185197 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 227/442] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:42 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:43.206084 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-df26c1bf-b118-45c0-9932-93fc22866b5f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:43.206692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-df26c1bf-b118-45c0-9932-93fc22866b5f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:43.213379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df26c1bf-b118-45c0-9932-93fc22866b5f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:43.213862 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df26c1bf-b118-45c0-9932-93fc22866b5f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:43.214292 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df26c1bf-b118-45c0-9932-93fc22866b5f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:43.214988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df26c1bf-b118-45c0-9932-93fc22866b5f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:43.215486 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df26c1bf-b118-45c0-9932-93fc22866b5f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:43.215921 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df26c1bf-b118-45c0-9932-93fc22866b5f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:43.368517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-df26c1bf-b118-45c0-9932-93fc22866b5f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:43.376539 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-df26c1bf-b118-45c0-9932-93fc22866b5f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.174459 Aug 08 13:38:43.377120 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 216/443] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:43 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:44.398564 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-12a8c87a-97c7-4936-ac38-cdc64d35cc81 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:44.399294 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-12a8c87a-97c7-4936-ac38-cdc64d35cc81 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:44.406089 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12a8c87a-97c7-4936-ac38-cdc64d35cc81 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:44.406571 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12a8c87a-97c7-4936-ac38-cdc64d35cc81 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:44.406999 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12a8c87a-97c7-4936-ac38-cdc64d35cc81 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:44.407732 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12a8c87a-97c7-4936-ac38-cdc64d35cc81 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:44.408179 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12a8c87a-97c7-4936-ac38-cdc64d35cc81 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:44.408586 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12a8c87a-97c7-4936-ac38-cdc64d35cc81 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:44.553791 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-12a8c87a-97c7-4936-ac38-cdc64d35cc81 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:44.562346 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-12a8c87a-97c7-4936-ac38-cdc64d35cc81 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.167549 Aug 08 13:38:44.562988 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 228/444] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:44 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:45.586350 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ec6c3aac-cf27-4749-a670-a3a152b6b6d5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:45.586970 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ec6c3aac-cf27-4749-a670-a3a152b6b6d5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:45.593932 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec6c3aac-cf27-4749-a670-a3a152b6b6d5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:45.594411 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec6c3aac-cf27-4749-a670-a3a152b6b6d5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:45.594837 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec6c3aac-cf27-4749-a670-a3a152b6b6d5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:45.595568 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec6c3aac-cf27-4749-a670-a3a152b6b6d5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:45.596014 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec6c3aac-cf27-4749-a670-a3a152b6b6d5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:45.596434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ec6c3aac-cf27-4749-a670-a3a152b6b6d5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:45.744097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ec6c3aac-cf27-4749-a670-a3a152b6b6d5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:45.755205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ec6c3aac-cf27-4749-a670-a3a152b6b6d5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.172624 Aug 08 13:38:45.755753 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 217/445] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:45 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:46.776014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ff9996d0-de69-4f45-a9f8-c6512c631ed9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:46.776666 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ff9996d0-de69-4f45-a9f8-c6512c631ed9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:46.784049 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff9996d0-de69-4f45-a9f8-c6512c631ed9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:46.784502 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff9996d0-de69-4f45-a9f8-c6512c631ed9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:46.784938 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff9996d0-de69-4f45-a9f8-c6512c631ed9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:46.785644 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff9996d0-de69-4f45-a9f8-c6512c631ed9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:46.786095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff9996d0-de69-4f45-a9f8-c6512c631ed9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:46.786525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff9996d0-de69-4f45-a9f8-c6512c631ed9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:46.920411 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ff9996d0-de69-4f45-a9f8-c6512c631ed9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:46.932391 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ff9996d0-de69-4f45-a9f8-c6512c631ed9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1370 microversion: 2.1 time: 0.160323 Aug 08 13:38:46.933588 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 229/446] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:46 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:47.959630 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2f37d385-d3bc-4e01-bfd7-d6a80fe20630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:47.960543 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2f37d385-d3bc-4e01-bfd7-d6a80fe20630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:47.968534 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f37d385-d3bc-4e01-bfd7-d6a80fe20630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:47.969027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f37d385-d3bc-4e01-bfd7-d6a80fe20630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:47.969681 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f37d385-d3bc-4e01-bfd7-d6a80fe20630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:47.970618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f37d385-d3bc-4e01-bfd7-d6a80fe20630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:47.971544 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f37d385-d3bc-4e01-bfd7-d6a80fe20630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:47.971978 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2f37d385-d3bc-4e01-bfd7-d6a80fe20630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:48.121862 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2f37d385-d3bc-4e01-bfd7-d6a80fe20630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:38:48.129439 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2f37d385-d3bc-4e01-bfd7-d6a80fe20630 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1564 microversion: 2.1 time: 0.174922 Aug 08 13:38:48.130009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 218/447] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:38:47 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:38:48.150960 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4a4b78ee-8b47-4e9e-9398-3bb31f374eaa tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:38:48.151627 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4a4b78ee-8b47-4e9e-9398-3bb31f374eaa tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:38:48.157603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4a4b78ee-8b47-4e9e-9398-3bb31f374eaa tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:48.158079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4a4b78ee-8b47-4e9e-9398-3bb31f374eaa tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:48.158501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4a4b78ee-8b47-4e9e-9398-3bb31f374eaa tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:48.159248 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4a4b78ee-8b47-4e9e-9398-3bb31f374eaa tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:48.159693 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4a4b78ee-8b47-4e9e-9398-3bb31f374eaa tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:48.160129 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4a4b78ee-8b47-4e9e-9398-3bb31f374eaa tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:48.242409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4a4b78ee-8b47-4e9e-9398-3bb31f374eaa tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095323 Aug 08 13:38:48.243102 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 230/448] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 13:38:48 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:38:49.520683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-c77c3a89-1432-48dc-a438-1ae0ce5a09a6 req-0b6961ef-1151-4726-979d-5881525c6a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f52d43d-f702-4083-8da1-ace76450a04d", "tag": "d64f2955-ff2d-41e6-bb65-c24de3c861ef"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:38:49.544270 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-c77c3a89-1432-48dc-a438-1ae0ce5a09a6 req-0b6961ef-1151-4726-979d-5881525c6a03 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:38:49.544915 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-c77c3a89-1432-48dc-a438-1ae0ce5a09a6 req-0b6961ef-1151-4726-979d-5881525c6a03 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:38:49.545621 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-c77c3a89-1432-48dc-a438-1ae0ce5a09a6 req-0b6961ef-1151-4726-979d-5881525c6a03 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:38:49.558450 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-c77c3a89-1432-48dc-a438-1ae0ce5a09a6 req-0b6961ef-1151-4726-979d-5881525c6a03 service nova] Creating event network-changed:d64f2955-ff2d-41e6-bb65-c24de3c861ef for instance 5f52d43d-f702-4083-8da1-ace76450a04d on hv-cinder-85199 Aug 08 13:38:49.565219 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-c77c3a89-1432-48dc-a438-1ae0ce5a09a6 req-0b6961ef-1151-4726-979d-5881525c6a03 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051502 Aug 08 13:38:49.565882 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 219/449] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:39:24.909624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:24.910643 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=56 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:24.916997 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c7fb28f0-b00f-4762-b499-f68d97d005de tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:24.917497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c7fb28f0-b00f-4762-b499-f68d97d005de tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:24.926130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7fb28f0-b00f-4762-b499-f68d97d005de tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:24.927025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7fb28f0-b00f-4762-b499-f68d97d005de tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:24.927936 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7fb28f0-b00f-4762-b499-f68d97d005de tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:24.928685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7fb28f0-b00f-4762-b499-f68d97d005de tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:24.929112 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7fb28f0-b00f-4762-b499-f68d97d005de tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:24.929563 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7fb28f0-b00f-4762-b499-f68d97d005de tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:24.956946 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c7fb28f0-b00f-4762-b499-f68d97d005de tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/ips" status: 200 len: 148 microversion: 2.1 time: 0.048708 Aug 08 13:39:24.957555 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 231/450] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 13:39:24 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:39:26.394970 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:26.395722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=58 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:26.400017 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-694f578a-d263-4a77-853d-9164641585d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af9287f1-5814-400e-932b-572d006f38d4"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:39:26.402440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-694f578a-d263-4a77-853d-9164641585d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:26.409619 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-694f578a-d263-4a77-853d-9164641585d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:26.410089 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-694f578a-d263-4a77-853d-9164641585d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:26.410505 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-694f578a-d263-4a77-853d-9164641585d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:26.411208 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-694f578a-d263-4a77-853d-9164641585d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:26.411642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-694f578a-d263-4a77-853d-9164641585d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:26.412051 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-694f578a-d263-4a77-853d-9164641585d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:26.718295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-694f578a-d263-4a77-853d-9164641585d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324662 Aug 08 13:39:26.719142 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 220/451] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:39:26 2022] POST /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:39:32.480935 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-390d264d-1187-402b-a7e2-6e03667197d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:32.481548 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-390d264d-1187-402b-a7e2-6e03667197d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:32.488490 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390d264d-1187-402b-a7e2-6e03667197d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:32.488993 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390d264d-1187-402b-a7e2-6e03667197d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:32.489419 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390d264d-1187-402b-a7e2-6e03667197d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:32.490126 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390d264d-1187-402b-a7e2-6e03667197d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:32.490577 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390d264d-1187-402b-a7e2-6e03667197d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:32.491004 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390d264d-1187-402b-a7e2-6e03667197d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:32.515563 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-390d264d-1187-402b-a7e2-6e03667197d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/ips" status: 200 len: 145 microversion: 2.1 time: 0.038490 Aug 08 13:39:32.516146 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 232/452] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 13:39:32 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:39:34.304068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8e63d177-d22b-430a-aaee-e67ec96a25ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: .version_select at 0x7f7d244421f0>, body: {"keypair": {"name": "tempest-keypair-1678759163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrfwebx3UR3QO2boTn8VtfQZI50KWW/aPAgE6IG/W8oaVXPzvUXgKczEHpcrSQ/FyUFCmFni3it9GfNW0vuqZZ6THZZQ78BwhbwdqcRveU/NptCHiTMxfnbuNJmZDy6Pw=="}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:39:34.322371 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-8e63d177-d22b-430a-aaee-e67ec96a25ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:39:34.326048 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-8e63d177-d22b-430a-aaee-e67ec96a25ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for user fce6a7d7dbc94adeb0b03bae34e335a0 and project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:39:34.339649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8e63d177-d22b-430a-aaee-e67ec96a25ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [6c376282-bea4-4686-9655-59d025e96d49] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 13:39:34.753762 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7b3e715f-afa3-428b-aee5-e1265edd7ba5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59897bbc-8f1d-446e-beea-0365854a0198"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:39:34.756278 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7b3e715f-afa3-428b-aee5-e1265edd7ba5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:34.762619 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b3e715f-afa3-428b-aee5-e1265edd7ba5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:34.763136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b3e715f-afa3-428b-aee5-e1265edd7ba5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:34.763573 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b3e715f-afa3-428b-aee5-e1265edd7ba5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:34.764271 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b3e715f-afa3-428b-aee5-e1265edd7ba5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:34.764719 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b3e715f-afa3-428b-aee5-e1265edd7ba5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:34.765137 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b3e715f-afa3-428b-aee5-e1265edd7ba5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:35.100233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7b3e715f-afa3-428b-aee5-e1265edd7ba5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350425 Aug 08 13:39:35.100868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 233/453] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:39:34 2022] POST /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:39:35.349441 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO oslo.messaging._drivers.impl_rabbit [None req-8e63d177-d22b-430a-aaee-e67ec96a25ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [6c376282-bea4-4686-9655-59d025e96d49] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 41676. Aug 08 13:39:35.367252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8e63d177-d22b-430a-aaee-e67ec96a25ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.067325 Aug 08 13:39:35.368059 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 221/454] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 13:39:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:39:36.771026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1455215358", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96099fae-9cab-447b-98a0-f55f4a95af9e"}], "security_groups": [{"name": "tempest-securitygroup--2019687718"}], "key_name": "tempest-keypair-1678759163", "user_data": "}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:39:36.885426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] validate_networks() for [('96099fae-9cab-447b-98a0-f55f4a95af9e', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:39:37.294846 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:39:37.295133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:39:37.295602 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:39:37.296566 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:39:37.296981 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:39:37.306639 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:37.307143 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:37.307596 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:37.308326 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:37.308773 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:37.309196 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:37.327010 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:39:37.331283 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for user fce6a7d7dbc94adeb0b03bae34e335a0 and project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:39:37.342794 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:39:37.345212 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:39:37.392983 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-00f3419a-ebdc-42a6-ae54-b62a2c9058da tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.627585 Aug 08 13:39:37.393652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 234/455] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:39:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:39:37.402053 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:37.406792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f42fd059-f9d6-4f22-a983-040ac101917a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:37.407523 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f42fd059-f9d6-4f22-a983-040ac101917a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:37.441240 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9f401cd6-a553-4a8a-9f6a-f5748f3d00fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:37.441864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9f401cd6-a553-4a8a-9f6a-f5748f3d00fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:37.449818 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f401cd6-a553-4a8a-9f6a-f5748f3d00fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:37.450433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f401cd6-a553-4a8a-9f6a-f5748f3d00fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:37.450906 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f401cd6-a553-4a8a-9f6a-f5748f3d00fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:37.451724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f401cd6-a553-4a8a-9f6a-f5748f3d00fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:37.452227 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f401cd6-a553-4a8a-9f6a-f5748f3d00fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:37.452683 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9f401cd6-a553-4a8a-9f6a-f5748f3d00fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:37.465794 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f42fd059-f9d6-4f22-a983-040ac101917a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:37.475524 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f42fd059-f9d6-4f22-a983-040ac101917a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1242 microversion: 2.1 time: 0.074438 Aug 08 13:39:37.476200 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 222/456] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:37 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:37.482702 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9f401cd6-a553-4a8a-9f6a-f5748f3d00fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/ips" status: 200 len: 153 microversion: 2.20 time: 0.042747 Aug 08 13:39:37.482702 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 235/457] 10.222.0.33 () {60 vars in 1289 bytes} [Mon Aug 8 13:39:37 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:39:38.497285 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-35c9dfe0-f00d-4c5d-a6fa-b7f725110858 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:38.497875 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-35c9dfe0-f00d-4c5d-a6fa-b7f725110858 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:38.504790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35c9dfe0-f00d-4c5d-a6fa-b7f725110858 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:38.505273 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35c9dfe0-f00d-4c5d-a6fa-b7f725110858 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:38.505705 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35c9dfe0-f00d-4c5d-a6fa-b7f725110858 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:38.506405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35c9dfe0-f00d-4c5d-a6fa-b7f725110858 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:38.506853 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35c9dfe0-f00d-4c5d-a6fa-b7f725110858 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:38.507311 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35c9dfe0-f00d-4c5d-a6fa-b7f725110858 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:38.572371 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-35c9dfe0-f00d-4c5d-a6fa-b7f725110858 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:38.581872 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-35c9dfe0-f00d-4c5d-a6fa-b7f725110858 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1302 microversion: 2.1 time: 0.088276 Aug 08 13:39:38.582719 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 223/458] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:38 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:39.327384 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8f0be0ad-f80d-41b1-9b30-3685206d6f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:39:39.328101 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8f0be0ad-f80d-41b1-9b30-3685206d6f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:39.334432 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8f0be0ad-f80d-41b1-9b30-3685206d6f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:39.334925 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8f0be0ad-f80d-41b1-9b30-3685206d6f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:39.335427 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8f0be0ad-f80d-41b1-9b30-3685206d6f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:39.336117 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8f0be0ad-f80d-41b1-9b30-3685206d6f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:39.336564 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8f0be0ad-f80d-41b1-9b30-3685206d6f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:39.336982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8f0be0ad-f80d-41b1-9b30-3685206d6f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:39.365557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-8f0be0ad-f80d-41b1-9b30-3685206d6f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lazy-loading 'flavor' on Instance uuid b337a957-cd21-4f51-aa36-f64ad24aee7c {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:39:39.604007 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4459a5a3-6d4e-44ce-829a-2d378f05bb76 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:39.605983 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4459a5a3-6d4e-44ce-829a-2d378f05bb76 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:39.607121 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8f0be0ad-f80d-41b1-9b30-3685206d6f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "POST /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/action" status: 202 len: 0 microversion: 2.20 time: 0.283635 Aug 08 13:39:39.608940 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 236/459] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Aug 8 13:39:39 2022] POST /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:39:39.617013 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4459a5a3-6d4e-44ce-829a-2d378f05bb76 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:39.621316 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:39.622064 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4459a5a3-6d4e-44ce-829a-2d378f05bb76 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:39.622649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4459a5a3-6d4e-44ce-829a-2d378f05bb76 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:39.623680 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4459a5a3-6d4e-44ce-829a-2d378f05bb76 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:39.624289 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4459a5a3-6d4e-44ce-829a-2d378f05bb76 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:39.624427 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:39.625481 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4459a5a3-6d4e-44ce-829a-2d378f05bb76 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:39.638334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:39.639168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:39.639624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:39.640320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:39.640838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:39.641416 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:39.860536 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4459a5a3-6d4e-44ce-829a-2d378f05bb76 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:39.868893 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4459a5a3-6d4e-44ce-829a-2d378f05bb76 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1368 microversion: 2.1 time: 0.269200 Aug 08 13:39:39.869836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 224/460] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:39 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1368 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:39.876113 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:39.884855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:39.886410 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:39.887701 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e0774b1e-a622-45db-84c2-04756b78e703 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.273199 Aug 08 13:39:39.888505 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 237/461] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:39 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:40.381778 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-050b07a3-2876-43bd-a729-cbe2edfd2cf1 req-3db1567c-cbc5-4845-ae34-cb4da9ecdc13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d56005-2c47-4e78-88a8-1e70921411ce", "tag": "e03791da-cff9-4890-9af8-f1729eb1a173"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:39:40.392396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-050b07a3-2876-43bd-a729-cbe2edfd2cf1 req-3db1567c-cbc5-4845-ae34-cb4da9ecdc13 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:40.393060 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-050b07a3-2876-43bd-a729-cbe2edfd2cf1 req-3db1567c-cbc5-4845-ae34-cb4da9ecdc13 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:40.393624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-050b07a3-2876-43bd-a729-cbe2edfd2cf1 req-3db1567c-cbc5-4845-ae34-cb4da9ecdc13 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:40.406559 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-050b07a3-2876-43bd-a729-cbe2edfd2cf1 req-3db1567c-cbc5-4845-ae34-cb4da9ecdc13 service nova] Creating event network-changed:e03791da-cff9-4890-9af8-f1729eb1a173 for instance 80d56005-2c47-4e78-88a8-1e70921411ce on hv-cinder-85199 Aug 08 13:39:40.411509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-050b07a3-2876-43bd-a729-cbe2edfd2cf1 req-3db1567c-cbc5-4845-ae34-cb4da9ecdc13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033421 Aug 08 13:39:40.412114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 225/462] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:39:40.890878 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a75682ad-d954-4d0c-89a4-240c5bad8097 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:40.892407 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a75682ad-d954-4d0c-89a4-240c5bad8097 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:40.899376 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a75682ad-d954-4d0c-89a4-240c5bad8097 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:40.899864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a75682ad-d954-4d0c-89a4-240c5bad8097 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:40.900457 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a75682ad-d954-4d0c-89a4-240c5bad8097 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:40.901195 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a75682ad-d954-4d0c-89a4-240c5bad8097 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:40.902335 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a75682ad-d954-4d0c-89a4-240c5bad8097 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:40.902770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a75682ad-d954-4d0c-89a4-240c5bad8097 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:40.920434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:40.921824 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:40.930425 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:40.931174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:40.931749 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:40.932552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:40.933093 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:40.933601 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:41.122503 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a75682ad-d954-4d0c-89a4-240c5bad8097 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:41.131116 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a75682ad-d954-4d0c-89a4-240c5bad8097 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1368 microversion: 2.1 time: 0.244136 Aug 08 13:39:41.131722 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 238/463] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:40 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:41.137416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:41.146580 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:41.148045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:41.149226 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-38d5a226-75cd-4b22-9372-e516aa35a041 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.233605 Aug 08 13:39:41.149794 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 226/464] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:40 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:42.152658 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1528d2f6-5caa-4558-a777-3b4b9143e88b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:42.153270 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1528d2f6-5caa-4558-a777-3b4b9143e88b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:42.160582 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1528d2f6-5caa-4558-a777-3b4b9143e88b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:42.161076 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1528d2f6-5caa-4558-a777-3b4b9143e88b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:42.161583 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1528d2f6-5caa-4558-a777-3b4b9143e88b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:42.162291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1528d2f6-5caa-4558-a777-3b4b9143e88b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:42.162742 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1528d2f6-5caa-4558-a777-3b4b9143e88b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:42.163202 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1528d2f6-5caa-4558-a777-3b4b9143e88b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:42.172309 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:42.172996 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:42.180186 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:42.180669 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:42.181102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:42.181800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:42.182251 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:42.182657 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:42.366736 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-1528d2f6-5caa-4558-a777-3b4b9143e88b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:42.375003 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1528d2f6-5caa-4558-a777-3b4b9143e88b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1368 microversion: 2.1 time: 0.226211 Aug 08 13:39:42.375789 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 239/465] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:42 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:42.382114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:42.391124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:42.392612 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:42.393805 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-15e212eb-efe0-4bd7-a690-453df5ff66fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.225454 Aug 08 13:39:42.394369 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 227/466] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:42 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:39:43.396159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bc2d8e1d-20f4-43fe-b276-7968bb6eff00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:43.396922 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bc2d8e1d-20f4-43fe-b276-7968bb6eff00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:43.403886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc2d8e1d-20f4-43fe-b276-7968bb6eff00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:43.404363 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc2d8e1d-20f4-43fe-b276-7968bb6eff00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:43.404790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc2d8e1d-20f4-43fe-b276-7968bb6eff00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:43.405530 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc2d8e1d-20f4-43fe-b276-7968bb6eff00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:43.405973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc2d8e1d-20f4-43fe-b276-7968bb6eff00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:43.406384 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc2d8e1d-20f4-43fe-b276-7968bb6eff00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:43.420460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:43.421250 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:43.428959 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:43.429442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:43.429864 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:43.430579 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:43.431018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:43.431461 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:43.631524 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bc2d8e1d-20f4-43fe-b276-7968bb6eff00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:43.639996 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:43.640618 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bc2d8e1d-20f4-43fe-b276-7968bb6eff00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1368 microversion: 2.1 time: 0.248261 Aug 08 13:39:43.641176 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 240/467] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:43 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:43.651497 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:43.653779 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:43.655568 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-dd377c2c-fe99-46f1-8d1a-1dc5583c42a1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.238950 Aug 08 13:39:43.656433 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 228/468] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:43 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:44.671151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8b7d2fbb-086b-4fba-8f6e-526152a1460f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:44.671869 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8b7d2fbb-086b-4fba-8f6e-526152a1460f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:44.681370 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8b7d2fbb-086b-4fba-8f6e-526152a1460f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:44.682155 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8b7d2fbb-086b-4fba-8f6e-526152a1460f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:44.682809 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8b7d2fbb-086b-4fba-8f6e-526152a1460f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:44.683858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8b7d2fbb-086b-4fba-8f6e-526152a1460f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:44.684790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8b7d2fbb-086b-4fba-8f6e-526152a1460f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:44.685519 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8b7d2fbb-086b-4fba-8f6e-526152a1460f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:44.686173 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:44.687644 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:44.700110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:44.700722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:44.701244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:44.702024 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:44.702520 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:44.702995 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:44.929573 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8b7d2fbb-086b-4fba-8f6e-526152a1460f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:44.930479 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:44.938734 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8b7d2fbb-086b-4fba-8f6e-526152a1460f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1368 microversion: 2.1 time: 0.271679 Aug 08 13:39:44.938954 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:44.940216 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 241/469] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:44 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:44.940434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:44.941610 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8a8a53ea-ae09-4696-ad1c-8abc31d2ea0e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.264343 Aug 08 13:39:44.942636 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 229/470] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:44 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:39:44.948553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d8eef105-a117-4412-aae5-af920b63aaeb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:39:44.955995 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d8eef105-a117-4412-aae5-af920b63aaeb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:44.956831 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d8eef105-a117-4412-aae5-af920b63aaeb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:44.957444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d8eef105-a117-4412-aae5-af920b63aaeb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:45.022243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d8eef105-a117-4412-aae5-af920b63aaeb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Going to try to stop instance {{(pid=124408) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 13:39:45.085944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d8eef105-a117-4412-aae5-af920b63aaeb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/action" status: 202 len: 0 microversion: 2.1 time: 0.142857 Aug 08 13:39:45.086454 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 242/471] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:39:44 2022] POST /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:39:45.095179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7dcb17c1-ca27-4e10-ab64-65fc955f4883 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:45.096062 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7dcb17c1-ca27-4e10-ab64-65fc955f4883 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:45.106547 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dcb17c1-ca27-4e10-ab64-65fc955f4883 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:45.108295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dcb17c1-ca27-4e10-ab64-65fc955f4883 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:45.109322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dcb17c1-ca27-4e10-ab64-65fc955f4883 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:45.111784 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dcb17c1-ca27-4e10-ab64-65fc955f4883 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:45.112876 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dcb17c1-ca27-4e10-ab64-65fc955f4883 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:45.113519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dcb17c1-ca27-4e10-ab64-65fc955f4883 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:45.268956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7dcb17c1-ca27-4e10-ab64-65fc955f4883 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:45.282159 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7dcb17c1-ca27-4e10-ab64-65fc955f4883 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.190528 Aug 08 13:39:45.283194 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 230/472] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:45 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:39:45.974760 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a2963cc2-b42f-46b8-8bd4-3f18b653b651 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:45.975659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a2963cc2-b42f-46b8-8bd4-3f18b653b651 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:45.976360 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:45.977020 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:45.983131 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2963cc2-b42f-46b8-8bd4-3f18b653b651 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:45.983655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2963cc2-b42f-46b8-8bd4-3f18b653b651 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:45.984091 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2963cc2-b42f-46b8-8bd4-3f18b653b651 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:45.984273 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:45.984752 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:45.984965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2963cc2-b42f-46b8-8bd4-3f18b653b651 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:45.985145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:45.985303 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2963cc2-b42f-46b8-8bd4-3f18b653b651 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:45.985659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2963cc2-b42f-46b8-8bd4-3f18b653b651 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:45.986158 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:45.987626 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:45.988309 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:46.195468 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a2963cc2-b42f-46b8-8bd4-3f18b653b651 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:46.200674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:46.204026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a2963cc2-b42f-46b8-8bd4-3f18b653b651 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1368 microversion: 2.1 time: 0.234817 Aug 08 13:39:46.204601 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 243/473] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:45 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:46.218751 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:46.220280 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:46.221451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-906e6a55-8f53-47cd-8bed-644061f2d8f0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.249117 Aug 08 13:39:46.222009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 231/474] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:45 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:46.305254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-70dfef54-8024-4f9b-9240-4319fdd9f074 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:46.305839 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-70dfef54-8024-4f9b-9240-4319fdd9f074 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:46.312080 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-70dfef54-8024-4f9b-9240-4319fdd9f074 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:46.312554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-70dfef54-8024-4f9b-9240-4319fdd9f074 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:46.313194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-70dfef54-8024-4f9b-9240-4319fdd9f074 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:46.313912 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-70dfef54-8024-4f9b-9240-4319fdd9f074 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:46.314367 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-70dfef54-8024-4f9b-9240-4319fdd9f074 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:46.314770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-70dfef54-8024-4f9b-9240-4319fdd9f074 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:46.359342 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-8def8928-eb8c-4c4f-a3f6-2768b0c0cdbe req-ffab7ec5-413e-4f4c-89ce-68f547d75dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d56005-2c47-4e78-88a8-1e70921411ce", "name": "network-vif-plugged", "status": "completed", "tag": "e03791da-cff9-4890-9af8-f1729eb1a173"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:39:46.369298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-8def8928-eb8c-4c4f-a3f6-2768b0c0cdbe req-ffab7ec5-413e-4f4c-89ce-68f547d75dc5 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:46.369776 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-8def8928-eb8c-4c4f-a3f6-2768b0c0cdbe req-ffab7ec5-413e-4f4c-89ce-68f547d75dc5 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:46.370228 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-8def8928-eb8c-4c4f-a3f6-2768b0c0cdbe req-ffab7ec5-413e-4f4c-89ce-68f547d75dc5 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:46.385631 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-8def8928-eb8c-4c4f-a3f6-2768b0c0cdbe req-ffab7ec5-413e-4f4c-89ce-68f547d75dc5 service nova] Creating event network-vif-plugged:e03791da-cff9-4890-9af8-f1729eb1a173 for instance 80d56005-2c47-4e78-88a8-1e70921411ce on hv-cinder-85199 Aug 08 13:39:46.392803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-8def8928-eb8c-4c4f-a3f6-2768b0c0cdbe req-ffab7ec5-413e-4f4c-89ce-68f547d75dc5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037503 Aug 08 13:39:46.394893 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 232/475] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:39:46.458781 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-70dfef54-8024-4f9b-9240-4319fdd9f074 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:46.462841 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:46.468254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-70dfef54-8024-4f9b-9240-4319fdd9f074 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.167103 Aug 08 13:39:46.468869 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 244/476] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:46 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:47.227855 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f764cecf-fd63-4af1-b7a1-2cee37b8ecbf tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:47.228550 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f764cecf-fd63-4af1-b7a1-2cee37b8ecbf tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:47.237160 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f764cecf-fd63-4af1-b7a1-2cee37b8ecbf tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:47.237989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f764cecf-fd63-4af1-b7a1-2cee37b8ecbf tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:47.239746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f764cecf-fd63-4af1-b7a1-2cee37b8ecbf tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:47.240064 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f764cecf-fd63-4af1-b7a1-2cee37b8ecbf tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:47.240849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f764cecf-fd63-4af1-b7a1-2cee37b8ecbf tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:47.241550 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f764cecf-fd63-4af1-b7a1-2cee37b8ecbf tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:47.249220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:47.253039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:47.263967 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:47.264590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:47.265109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:47.266154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:47.266874 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:47.267475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:47.315788 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:47.338508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:47.459880 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f764cecf-fd63-4af1-b7a1-2cee37b8ecbf tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:47.464943 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:47.469806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f764cecf-fd63-4af1-b7a1-2cee37b8ecbf tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1368 microversion: 2.1 time: 0.247083 Aug 08 13:39:47.470411 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 233/477] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:47 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:47.474380 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:47.475898 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:47.477054 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bf8e003d-88ff-4d6d-a6e1-e434d054623f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.235183 Aug 08 13:39:47.477589 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 245/478] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:47 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:47.495550 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a0d83225-a938-4c96-a2f3-5ca7d094ad46 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:47.496162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a0d83225-a938-4c96-a2f3-5ca7d094ad46 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:47.498101 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:47.503687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0d83225-a938-4c96-a2f3-5ca7d094ad46 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:47.504191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0d83225-a938-4c96-a2f3-5ca7d094ad46 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:47.504617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0d83225-a938-4c96-a2f3-5ca7d094ad46 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:47.505301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0d83225-a938-4c96-a2f3-5ca7d094ad46 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:47.505745 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0d83225-a938-4c96-a2f3-5ca7d094ad46 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:47.506162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0d83225-a938-4c96-a2f3-5ca7d094ad46 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:47.647887 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a0d83225-a938-4c96-a2f3-5ca7d094ad46 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:47.656399 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a0d83225-a938-4c96-a2f3-5ca7d094ad46 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.164587 Aug 08 13:39:47.657015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 234/479] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:47 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:48.492009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d350579b-1cbe-4fa2-852e-8db23e16ad04 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:48.492623 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d350579b-1cbe-4fa2-852e-8db23e16ad04 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:48.499547 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d350579b-1cbe-4fa2-852e-8db23e16ad04 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:48.500063 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d350579b-1cbe-4fa2-852e-8db23e16ad04 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:48.500416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:48.501014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d350579b-1cbe-4fa2-852e-8db23e16ad04 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:48.501115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:48.501226 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d350579b-1cbe-4fa2-852e-8db23e16ad04 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:48.501596 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d350579b-1cbe-4fa2-852e-8db23e16ad04 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:48.502018 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d350579b-1cbe-4fa2-852e-8db23e16ad04 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:48.508411 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:48.508899 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:48.509324 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:48.510036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:48.510514 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:48.510931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:48.711352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d350579b-1cbe-4fa2-852e-8db23e16ad04 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:48.715297 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:48.719948 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d350579b-1cbe-4fa2-852e-8db23e16ad04 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1556 microversion: 2.1 time: 0.231946 Aug 08 13:39:48.720535 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 246/480] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:48 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1556 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:48.724638 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:48.726295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:48.727513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7804b85d-16bb-4e3b-ad98-97a710d1b6a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.231094 Aug 08 13:39:48.728099 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 235/481] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:48 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:39:48.737448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-be6ed1fa-da83-4b0d-a716-d3ef0ac6cb6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:48.738061 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-be6ed1fa-da83-4b0d-a716-d3ef0ac6cb6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:48.744956 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-be6ed1fa-da83-4b0d-a716-d3ef0ac6cb6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:48.745722 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-be6ed1fa-da83-4b0d-a716-d3ef0ac6cb6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:48.746032 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-be6ed1fa-da83-4b0d-a716-d3ef0ac6cb6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:48.746631 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-be6ed1fa-da83-4b0d-a716-d3ef0ac6cb6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:48.747106 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-be6ed1fa-da83-4b0d-a716-d3ef0ac6cb6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:48.747550 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-be6ed1fa-da83-4b0d-a716-d3ef0ac6cb6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:48.755249 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b051edba-cc8d-436a-9df4-f5566fd1ccbd tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:48.755728 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b051edba-cc8d-436a-9df4-f5566fd1ccbd tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:48.770009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b051edba-cc8d-436a-9df4-f5566fd1ccbd tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:48.770519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b051edba-cc8d-436a-9df4-f5566fd1ccbd tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:48.770951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b051edba-cc8d-436a-9df4-f5566fd1ccbd tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:48.771683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b051edba-cc8d-436a-9df4-f5566fd1ccbd tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:48.772156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b051edba-cc8d-436a-9df4-f5566fd1ccbd tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:48.772525 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b051edba-cc8d-436a-9df4-f5566fd1ccbd tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:48.883617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b051edba-cc8d-436a-9df4-f5566fd1ccbd tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136648 Aug 08 13:39:48.884249 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 236/482] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 13:39:48 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:39:48.923704 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-be6ed1fa-da83-4b0d-a716-d3ef0ac6cb6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:48.932946 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-be6ed1fa-da83-4b0d-a716-d3ef0ac6cb6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.199300 Aug 08 13:39:48.933739 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 247/483] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:48 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:49.751664 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:49.752310 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:49.758850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:49.759716 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:49.760151 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:49.760903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:49.761350 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:49.761811 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:49.908061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:49.918740 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:49.920861 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:49.922317 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2ccfbc6c-aecd-4dd4-9b3c-c08c1f6d3093 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.175203 Aug 08 13:39:49.923203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 237/484] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:49 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:49.958377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-cca83b62-7760-4f42-a4f5-b59ac17e464e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:49.959465 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-cca83b62-7760-4f42-a4f5-b59ac17e464e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:49.969756 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cca83b62-7760-4f42-a4f5-b59ac17e464e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:49.970287 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cca83b62-7760-4f42-a4f5-b59ac17e464e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:49.970721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cca83b62-7760-4f42-a4f5-b59ac17e464e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:49.971442 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cca83b62-7760-4f42-a4f5-b59ac17e464e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:49.971891 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cca83b62-7760-4f42-a4f5-b59ac17e464e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:49.972312 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cca83b62-7760-4f42-a4f5-b59ac17e464e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:50.105839 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-cca83b62-7760-4f42-a4f5-b59ac17e464e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:50.114433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-cca83b62-7760-4f42-a4f5-b59ac17e464e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.163195 Aug 08 13:39:50.115009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 248/485] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:49 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:50.306994 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-3745b92e-8f15-409e-986a-00821ad97af5 req-5ea575dc-e7fd-4fa6-a4e7-b821d1ed5d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d56005-2c47-4e78-88a8-1e70921411ce", "tag": "e03791da-cff9-4890-9af8-f1729eb1a173"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:39:50.317375 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-3745b92e-8f15-409e-986a-00821ad97af5 req-5ea575dc-e7fd-4fa6-a4e7-b821d1ed5d69 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:50.317843 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-3745b92e-8f15-409e-986a-00821ad97af5 req-5ea575dc-e7fd-4fa6-a4e7-b821d1ed5d69 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:50.318261 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-3745b92e-8f15-409e-986a-00821ad97af5 req-5ea575dc-e7fd-4fa6-a4e7-b821d1ed5d69 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:50.330533 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-3745b92e-8f15-409e-986a-00821ad97af5 req-5ea575dc-e7fd-4fa6-a4e7-b821d1ed5d69 service nova] Creating event network-changed:e03791da-cff9-4890-9af8-f1729eb1a173 for instance 80d56005-2c47-4e78-88a8-1e70921411ce on hv-cinder-85199 Aug 08 13:39:50.335945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-3745b92e-8f15-409e-986a-00821ad97af5 req-5ea575dc-e7fd-4fa6-a4e7-b821d1ed5d69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032602 Aug 08 13:39:50.336576 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 238/486] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:39:50.952547 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:50.953606 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:50.960164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:50.960812 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:50.961072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:50.961810 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:50.962260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:50.962682 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:51.136685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:51.140652 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4f8225c1-3fe9-417b-bfbe-46270c4cf8d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:51.142329 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4f8225c1-3fe9-417b-bfbe-46270c4cf8d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:51.144896 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:51.146430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:51.147636 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ad71dbce-3717-4841-8090-3f6ff8a88dbd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.200275 Aug 08 13:39:51.148170 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 249/487] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:50 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:51.150483 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8225c1-3fe9-417b-bfbe-46270c4cf8d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:51.150964 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8225c1-3fe9-417b-bfbe-46270c4cf8d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:51.151466 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8225c1-3fe9-417b-bfbe-46270c4cf8d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:51.152165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8225c1-3fe9-417b-bfbe-46270c4cf8d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:51.152608 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8225c1-3fe9-417b-bfbe-46270c4cf8d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:51.153023 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4f8225c1-3fe9-417b-bfbe-46270c4cf8d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:51.293125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4f8225c1-3fe9-417b-bfbe-46270c4cf8d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:51.301817 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4f8225c1-3fe9-417b-bfbe-46270c4cf8d0 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.168474 Aug 08 13:39:51.302528 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 239/488] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:51 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:39:52.172676 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:52.173411 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:52.180253 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:52.180819 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:52.181164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:52.181856 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:52.182311 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:52.182728 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:52.327642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-46f838b8-2621-4cb8-96f5-563d87d2d3ed tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:52.328275 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:52.328406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-46f838b8-2621-4cb8-96f5-563d87d2d3ed tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:52.337354 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f838b8-2621-4cb8-96f5-563d87d2d3ed tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:52.337859 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f838b8-2621-4cb8-96f5-563d87d2d3ed tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:52.337994 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:52.338304 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f838b8-2621-4cb8-96f5-563d87d2d3ed tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:52.339150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f838b8-2621-4cb8-96f5-563d87d2d3ed tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:52.339718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:52.339888 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f838b8-2621-4cb8-96f5-563d87d2d3ed tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:52.340655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f838b8-2621-4cb8-96f5-563d87d2d3ed tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:52.341008 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4489aa1f-cd58-4b00-8851-ad1860da588d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1744 microversion: 2.20 time: 0.172457 Aug 08 13:39:52.341629 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 250/489] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:52 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:52.512156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-46f838b8-2621-4cb8-96f5-563d87d2d3ed tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:52.520449 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-46f838b8-2621-4cb8-96f5-563d87d2d3ed tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.199624 Aug 08 13:39:52.520917 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 240/490] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:52 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:53.380550 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:53.381150 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:53.389100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:53.389831 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:53.390511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:53.391327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:53.391890 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:53.392582 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:53.537472 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:53.541710 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-085447db-794a-4610-a7b6-072ff9bf15bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:53.542492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-085447db-794a-4610-a7b6-072ff9bf15bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:53.546494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:53.548162 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:53.548721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-085447db-794a-4610-a7b6-072ff9bf15bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:53.549206 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-085447db-794a-4610-a7b6-072ff9bf15bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:53.549636 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-085447db-794a-4610-a7b6-072ff9bf15bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:53.549883 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0c284fc9-5341-42eb-a8aa-6735b9b72bd8 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1744 microversion: 2.20 time: 0.173349 Aug 08 13:39:53.550336 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-085447db-794a-4610-a7b6-072ff9bf15bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:53.550463 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 251/491] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:53 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:53.550781 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-085447db-794a-4610-a7b6-072ff9bf15bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:53.551431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-085447db-794a-4610-a7b6-072ff9bf15bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:53.692295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-085447db-794a-4610-a7b6-072ff9bf15bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:53.695878 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=100 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:53.701444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-085447db-794a-4610-a7b6-072ff9bf15bf tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.163555 Aug 08 13:39:53.702018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 241/492] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:53 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:39:54.575910 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:54.576490 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:54.584020 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:54.584481 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:54.584932 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:54.585625 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:54.586073 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:54.586503 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:54.724854 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7aa5cf9f-13c9-4fd2-ae27-eb364078e933 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:54.726559 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7aa5cf9f-13c9-4fd2-ae27-eb364078e933 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:54.735958 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf9f-13c9-4fd2-ae27-eb364078e933 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:54.736859 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf9f-13c9-4fd2-ae27-eb364078e933 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:54.737401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf9f-13c9-4fd2-ae27-eb364078e933 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:54.738142 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:54.738362 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf9f-13c9-4fd2-ae27-eb364078e933 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:54.738833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf9f-13c9-4fd2-ae27-eb364078e933 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:54.739387 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7aa5cf9f-13c9-4fd2-ae27-eb364078e933 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:54.755737 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:54.758652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:54.760825 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a15886fc-2dfd-4dbf-8dbb-0b54f5eab9c2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1744 microversion: 2.20 time: 0.190320 Aug 08 13:39:54.761782 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 252/493] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:54 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1744 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:54.884622 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7aa5cf9f-13c9-4fd2-ae27-eb364078e933 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:54.892772 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7aa5cf9f-13c9-4fd2-ae27-eb364078e933 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.173624 Aug 08 13:39:54.893338 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 242/494] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:54 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:39:55.786781 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:55.787415 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:55.789863 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:55.796611 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:55.797212 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:55.797801 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:55.798868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:55.799607 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:55.800197 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:55.913849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-cf18fc8e-7f1b-491b-94f1-127a6f4582d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:55.914561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-cf18fc8e-7f1b-491b-94f1-127a6f4582d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:55.921150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf18fc8e-7f1b-491b-94f1-127a6f4582d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:55.921668 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf18fc8e-7f1b-491b-94f1-127a6f4582d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:55.922075 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf18fc8e-7f1b-491b-94f1-127a6f4582d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:55.922801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf18fc8e-7f1b-491b-94f1-127a6f4582d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:55.923406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf18fc8e-7f1b-491b-94f1-127a6f4582d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:55.923828 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf18fc8e-7f1b-491b-94f1-127a6f4582d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:55.941322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:55.950672 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:55.952285 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:55.953555 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-26ec9d87-0204-4105-845c-c672e7503e2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1744 microversion: 2.20 time: 0.171233 Aug 08 13:39:55.954183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 253/495] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:55 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:56.066407 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-cf18fc8e-7f1b-491b-94f1-127a6f4582d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:56.075914 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-cf18fc8e-7f1b-491b-94f1-127a6f4582d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.165795 Aug 08 13:39:56.076624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 243/496] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:55 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:56.395518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-f2c38aa6-dc66-4033-a38b-5c6f28925345 req-258eac36-b9f4-4c78-8fff-c33c9e41a0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b337a957-cd21-4f51-aa36-f64ad24aee7c", "name": "network-vif-plugged", "status": "completed", "tag": "9caada1c-52b2-4c87-b709-be921f77a3b5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:39:56.408519 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-f2c38aa6-dc66-4033-a38b-5c6f28925345 req-258eac36-b9f4-4c78-8fff-c33c9e41a0cf service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:56.409103 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-f2c38aa6-dc66-4033-a38b-5c6f28925345 req-258eac36-b9f4-4c78-8fff-c33c9e41a0cf service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:56.409749 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-f2c38aa6-dc66-4033-a38b-5c6f28925345 req-258eac36-b9f4-4c78-8fff-c33c9e41a0cf service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:56.424039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-f2c38aa6-dc66-4033-a38b-5c6f28925345 req-258eac36-b9f4-4c78-8fff-c33c9e41a0cf service nova] Creating event network-vif-plugged:9caada1c-52b2-4c87-b709-be921f77a3b5 for instance b337a957-cd21-4f51-aa36-f64ad24aee7c on hv-cinder-85199 Aug 08 13:39:56.429733 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-f2c38aa6-dc66-4033-a38b-5c6f28925345 req-258eac36-b9f4-4c78-8fff-c33c9e41a0cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039631 Aug 08 13:39:56.430486 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 254/497] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:39:56.978820 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:56.979435 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:56.982078 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:39:56.988774 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:56.989298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:56.989762 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:56.990444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:56.990894 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:56.991304 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:57.099382 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0166c7cc-c692-4bd5-bf88-f1ba4c4ffa98 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:57.100245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0166c7cc-c692-4bd5-bf88-f1ba4c4ffa98 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:57.107190 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0166c7cc-c692-4bd5-bf88-f1ba4c4ffa98 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:57.107677 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0166c7cc-c692-4bd5-bf88-f1ba4c4ffa98 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:57.108084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0166c7cc-c692-4bd5-bf88-f1ba4c4ffa98 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:57.108798 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0166c7cc-c692-4bd5-bf88-f1ba4c4ffa98 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:57.109236 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0166c7cc-c692-4bd5-bf88-f1ba4c4ffa98 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:57.109655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0166c7cc-c692-4bd5-bf88-f1ba4c4ffa98 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:57.133260 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:57.141405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:57.142906 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:57.144106 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-273f5a50-5987-4091-8210-5d4f90c77e32 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1744 microversion: 2.20 time: 0.169338 Aug 08 13:39:57.144703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 244/498] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:56 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:57.241413 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0166c7cc-c692-4bd5-bf88-f1ba4c4ffa98 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:57.249548 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0166c7cc-c692-4bd5-bf88-f1ba4c4ffa98 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.155320 Aug 08 13:39:57.250128 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 255/499] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:57 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:58.167466 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:58.168066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:58.174751 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:58.175267 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:58.175713 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:58.176539 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:58.176805 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:58.177527 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:58.272375 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a3d46d6a-d3f7-4d64-b93d-17d1c380a567 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:58.273601 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a3d46d6a-d3f7-4d64-b93d-17d1c380a567 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:58.288063 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3d46d6a-d3f7-4d64-b93d-17d1c380a567 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:58.288787 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3d46d6a-d3f7-4d64-b93d-17d1c380a567 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:58.289408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3d46d6a-d3f7-4d64-b93d-17d1c380a567 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:58.290340 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3d46d6a-d3f7-4d64-b93d-17d1c380a567 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:58.290989 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3d46d6a-d3f7-4d64-b93d-17d1c380a567 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:58.291819 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3d46d6a-d3f7-4d64-b93d-17d1c380a567 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:58.329248 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:58.339420 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:58.341951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:58.343368 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0790797d-f96c-4aa4-b7a2-4da3a9832e93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1739 microversion: 2.20 time: 0.179889 Aug 08 13:39:58.344330 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 245/500] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:58 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:39:58.487683 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a3d46d6a-d3f7-4d64-b93d-17d1c380a567 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:58.496724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a3d46d6a-d3f7-4d64-b93d-17d1c380a567 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.228425 Aug 08 13:39:58.497310 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 256/501] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:58 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:39:59.368754 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:59.369375 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:59.377194 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:59.377822 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:59.378676 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:59.380948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:59.382088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:59.383057 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:59.520078 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6c2d9a9e-196e-4555-bc45-f05025899de2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:39:59.522579 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6c2d9a9e-196e-4555-bc45-f05025899de2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:39:59.532721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6c2d9a9e-196e-4555-bc45-f05025899de2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:59.533434 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6c2d9a9e-196e-4555-bc45-f05025899de2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:59.533812 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6c2d9a9e-196e-4555-bc45-f05025899de2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:59.534719 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6c2d9a9e-196e-4555-bc45-f05025899de2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:39:59.535430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6c2d9a9e-196e-4555-bc45-f05025899de2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:39:59.536015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6c2d9a9e-196e-4555-bc45-f05025899de2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:39:59.538821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:59.559529 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:59.565791 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:59.567012 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6e7258af-9e25-4633-9b28-c7802686bb2b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1739 microversion: 2.20 time: 0.202503 Aug 08 13:39:59.574410 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 246/502] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:39:59 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:39:59.711033 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6c2d9a9e-196e-4555-bc45-f05025899de2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:39:59.720581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6c2d9a9e-196e-4555-bc45-f05025899de2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1723 microversion: 2.1 time: 0.206230 Aug 08 13:39:59.721165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 257/503] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:39:59 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:00.597491 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:00.598581 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:00.623992 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:00.624560 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:00.624987 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:00.625683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:00.626242 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:00.626654 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:00.742056 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0c87ccdd-de25-42ea-9bb2-a832b13f298f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:00.743104 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0c87ccdd-de25-42ea-9bb2-a832b13f298f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:00.749932 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c87ccdd-de25-42ea-9bb2-a832b13f298f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:00.750602 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c87ccdd-de25-42ea-9bb2-a832b13f298f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:00.751185 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c87ccdd-de25-42ea-9bb2-a832b13f298f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:00.751952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c87ccdd-de25-42ea-9bb2-a832b13f298f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:00.752721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c87ccdd-de25-42ea-9bb2-a832b13f298f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:00.753211 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0c87ccdd-de25-42ea-9bb2-a832b13f298f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:00.789882 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:00.800043 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:00.802013 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:00.803596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-70bef545-32f2-4c05-a19a-3d1420a6ebb0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1739 microversion: 2.20 time: 0.216911 Aug 08 13:40:00.805071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 247/504] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:00 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:40:00.910174 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0c87ccdd-de25-42ea-9bb2-a832b13f298f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:00.919449 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0c87ccdd-de25-42ea-9bb2-a832b13f298f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1700 microversion: 2.1 time: 0.181245 Aug 08 13:40:00.920344 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 258/505] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:00 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1700 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:40:00.943222 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a668decf-cd0b-4ef7-b4b8-539a6dad3f02 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:40:00.949792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a668decf-cd0b-4ef7-b4b8-539a6dad3f02 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:00.950607 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a668decf-cd0b-4ef7-b4b8-539a6dad3f02 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:00.950732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a668decf-cd0b-4ef7-b4b8-539a6dad3f02 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:01.020786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a668decf-cd0b-4ef7-b4b8-539a6dad3f02 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Going to try to start instance {{(pid=124407) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 13:40:01.105999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a668decf-cd0b-4ef7-b4b8-539a6dad3f02 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/action" status: 202 len: 0 microversion: 2.1 time: 0.166859 Aug 08 13:40:01.108130 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 248/506] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:40:00 2022] POST /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:40:01.138494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d8ff2be2-b166-46c8-a286-805b82bc5479 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:01.139513 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d8ff2be2-b166-46c8-a286-805b82bc5479 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:01.149453 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d8ff2be2-b166-46c8-a286-805b82bc5479 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:01.150120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d8ff2be2-b166-46c8-a286-805b82bc5479 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:01.150877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d8ff2be2-b166-46c8-a286-805b82bc5479 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:01.152093 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d8ff2be2-b166-46c8-a286-805b82bc5479 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:01.152556 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d8ff2be2-b166-46c8-a286-805b82bc5479 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:01.152982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d8ff2be2-b166-46c8-a286-805b82bc5479 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:01.322361 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d8ff2be2-b166-46c8-a286-805b82bc5479 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:01.333262 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d8ff2be2-b166-46c8-a286-805b82bc5479 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1709 microversion: 2.1 time: 0.217658 Aug 08 13:40:01.350603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 259/507] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:01 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1709 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:01.832790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:01.833696 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:01.840954 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:01.841606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:01.842588 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:01.845907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:01.847396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:01.847951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:02.031655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:02.043802 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:02.045693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:02.047277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-31aa5574-98cd-4b60-a374-e4f1756a2fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1739 microversion: 2.20 time: 0.220907 Aug 08 13:40:02.048418 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 249/508] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:01 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:02.355826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bca42bb5-b52d-495a-8cfb-fc3b589af4ea tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:02.357069 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bca42bb5-b52d-495a-8cfb-fc3b589af4ea tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:02.363775 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bca42bb5-b52d-495a-8cfb-fc3b589af4ea tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:02.364327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bca42bb5-b52d-495a-8cfb-fc3b589af4ea tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:02.364827 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bca42bb5-b52d-495a-8cfb-fc3b589af4ea tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:02.365568 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bca42bb5-b52d-495a-8cfb-fc3b589af4ea tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:02.366093 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bca42bb5-b52d-495a-8cfb-fc3b589af4ea tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:02.366685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bca42bb5-b52d-495a-8cfb-fc3b589af4ea tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:02.528557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bca42bb5-b52d-495a-8cfb-fc3b589af4ea tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:02.537532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bca42bb5-b52d-495a-8cfb-fc3b589af4ea tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1709 microversion: 2.1 time: 0.185716 Aug 08 13:40:02.538392 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 260/509] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:02 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1709 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:03.073798 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:03.074424 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:03.083447 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:03.083948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:03.084401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:03.085182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:03.085642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:03.086059 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:03.236585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:03.245642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:03.247224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:03.248428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e6ebe8bb-d00e-4a51-b97e-bf8e81f5d46a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1739 microversion: 2.20 time: 0.179100 Aug 08 13:40:03.249402 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 250/510] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:03 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:03.560649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-12afb6f9-a2ad-4c2f-bbd5-15b3dc3dd1e3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:03.562183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-12afb6f9-a2ad-4c2f-bbd5-15b3dc3dd1e3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:03.569757 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12afb6f9-a2ad-4c2f-bbd5-15b3dc3dd1e3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:03.570337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12afb6f9-a2ad-4c2f-bbd5-15b3dc3dd1e3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:03.570873 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12afb6f9-a2ad-4c2f-bbd5-15b3dc3dd1e3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:03.571712 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12afb6f9-a2ad-4c2f-bbd5-15b3dc3dd1e3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:03.572247 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12afb6f9-a2ad-4c2f-bbd5-15b3dc3dd1e3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:03.572773 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-12afb6f9-a2ad-4c2f-bbd5-15b3dc3dd1e3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:03.734871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-12afb6f9-a2ad-4c2f-bbd5-15b3dc3dd1e3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:03.743552 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-12afb6f9-a2ad-4c2f-bbd5-15b3dc3dd1e3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1713 microversion: 2.1 time: 0.186872 Aug 08 13:40:03.744139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 261/511] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:03 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1713 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:04.273058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:04.273683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:04.281161 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:04.281577 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:04.282004 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:04.282729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:04.283174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:04.283598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:04.436910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:04.445714 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:04.447367 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:04.448788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3d79b4b5-ada7-455f-9929-555097e8267e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1739 microversion: 2.20 time: 0.179889 Aug 08 13:40:04.463607 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 251/512] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:04 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:05.478097 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:05.478986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:05.486141 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:05.486654 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:05.487038 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:05.487798 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:05.488245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:05.488806 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:05.506727 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=100 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:40:05.636656 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:05.645973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:05.647622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:05.648872 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-438f4831-1186-48d1-bd85-50737bcd09d9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1739 microversion: 2.20 time: 0.175715 Aug 08 13:40:05.658533 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 262/513] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:05 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:06.674238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:06.674901 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:06.683852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:06.684639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:06.685037 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:06.686367 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:06.687353 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:06.687704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:07.118388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:07.129800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:07.131456 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:07.132616 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f0097e6c-5027-4277-a73c-131acbd00514 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1739 microversion: 2.20 time: 0.463092 Aug 08 13:40:07.133165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 252/514] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:06 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1739 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:08.157119 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:08.157753 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:08.164735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:08.165220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:08.165650 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:08.166341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:08.166788 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:08.167238 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:08.310807 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:08.321564 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:08.323018 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:08.324245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-736571c6-9038-45be-b65f-81c89ffa520a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1739 microversion: 2.20 time: 0.171152 Aug 08 13:40:08.324839 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 263/515] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:08 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:09.347933 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:09.348517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:09.355514 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:09.355997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:09.356776 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:09.357468 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:09.357919 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:09.358332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:09.509546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:09.517785 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:09.519322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:09.520459 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5ab93aff-8cf3-4fac-a384-3b46ee874b18 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1721 microversion: 2.20 time: 0.176687 Aug 08 13:40:09.521027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 253/516] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:09 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:10.422688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-bf89b614-a16f-478c-a540-5b8abc6d3a05 req-d49fef5e-1839-4d89-9b51-b41c7124a7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b337a957-cd21-4f51-aa36-f64ad24aee7c", "name": "network-vif-unplugged", "status": "completed", "tag": "9caada1c-52b2-4c87-b709-be921f77a3b5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:40:10.433154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-bf89b614-a16f-478c-a540-5b8abc6d3a05 req-d49fef5e-1839-4d89-9b51-b41c7124a7e2 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:10.433629 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-bf89b614-a16f-478c-a540-5b8abc6d3a05 req-d49fef5e-1839-4d89-9b51-b41c7124a7e2 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:10.434400 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-bf89b614-a16f-478c-a540-5b8abc6d3a05 req-d49fef5e-1839-4d89-9b51-b41c7124a7e2 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:10.446252 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-bf89b614-a16f-478c-a540-5b8abc6d3a05 req-d49fef5e-1839-4d89-9b51-b41c7124a7e2 service nova] Creating event network-vif-unplugged:9caada1c-52b2-4c87-b709-be921f77a3b5 for instance b337a957-cd21-4f51-aa36-f64ad24aee7c on hv-cinder-85199 Aug 08 13:40:10.451434 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-bf89b614-a16f-478c-a540-5b8abc6d3a05 req-d49fef5e-1839-4d89-9b51-b41c7124a7e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032719 Aug 08 13:40:10.452025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 264/517] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:40:10.544274 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:10.544816 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:10.551706 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:10.552179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:10.552608 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:10.553291 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:10.553736 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:10.554134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:10.864515 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:10.873050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:10.874533 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:10.875809 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-631db4d2-6b7c-4c4f-9430-59fed00f00ae tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1721 microversion: 2.20 time: 0.335575 Aug 08 13:40:10.876584 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 254/518] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:10 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:11.900644 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:11.901304 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:11.909136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:11.909688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:11.910120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:11.910901 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:11.911507 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:11.912152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:12.120125 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:12.129361 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:12.131360 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:12.132855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ba8be9a4-4dff-476f-9968-42ce162ce995 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1664 microversion: 2.20 time: 0.237044 Aug 08 13:40:12.133475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 265/519] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:11 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1664 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:12.156248 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6b656c97-2487-4ce1-a53f-1706c4cb6a7a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1faec280-b6d0-42c0-86f8-fb45b9a4d480"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:40:12.158677 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6b656c97-2487-4ce1-a53f-1706c4cb6a7a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:12.165652 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6b656c97-2487-4ce1-a53f-1706c4cb6a7a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:12.166136 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6b656c97-2487-4ce1-a53f-1706c4cb6a7a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:12.166566 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6b656c97-2487-4ce1-a53f-1706c4cb6a7a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:12.167300 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6b656c97-2487-4ce1-a53f-1706c4cb6a7a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:12.167757 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6b656c97-2487-4ce1-a53f-1706c4cb6a7a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:12.168171 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6b656c97-2487-4ce1-a53f-1706c4cb6a7a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:12.376003 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:40:12.476864 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6b656c97-2487-4ce1-a53f-1706c4cb6a7a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "POST /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324710 Aug 08 13:40:12.477501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 255/520] 10.222.0.33 () {62 vars in 1364 bytes} [Mon Aug 8 13:40:12 2022] POST /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:40:12.600462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-266c7802-7f08-4b18-b941-3a8db4366bb5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:40:12.601041 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-266c7802-7f08-4b18-b941-3a8db4366bb5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:12.607495 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-266c7802-7f08-4b18-b941-3a8db4366bb5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:12.607977 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-266c7802-7f08-4b18-b941-3a8db4366bb5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:12.608400 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-266c7802-7f08-4b18-b941-3a8db4366bb5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:12.609061 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-266c7802-7f08-4b18-b941-3a8db4366bb5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:12.609507 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-266c7802-7f08-4b18-b941-3a8db4366bb5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:12.609917 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-266c7802-7f08-4b18-b941-3a8db4366bb5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:12.654381 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-266c7802-7f08-4b18-b941-3a8db4366bb5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124408) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 13:40:12.729814 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-266c7802-7f08-4b18-b941-3a8db4366bb5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "POST /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/action" status: 202 len: 0 microversion: 2.20 time: 0.133247 Aug 08 13:40:12.731301 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 266/521] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Aug 8 13:40:12 2022] POST /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:40:12.739184 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:12.739794 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:12.745759 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:12.746228 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:12.746655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:12.747404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:12.747822 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:12.748209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:12.894156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:12.902795 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:12.904308 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:12.905455 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ddc17a89-58f9-4dde-8081-66f88e046089 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1750 microversion: 2.20 time: 0.170321 Aug 08 13:40:12.906040 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 256/522] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:12 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:13.930210 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:13.930905 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:13.937640 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:13.938161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:13.938601 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:13.939423 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:13.939876 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:13.940304 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:14.084080 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:14.098529 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:14.100676 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:14.102568 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-336ced71-bc7e-4d51-9ad8-06d2452a56e7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1752 microversion: 2.20 time: 0.176588 Aug 08 13:40:14.103527 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 267/523] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:13 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:15.129071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:15.129695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:15.136466 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:15.136942 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:15.137387 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:15.138069 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:15.138552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:15.138974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:15.284357 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:15.297973 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:15.299505 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:15.300942 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f8c7c079-9a46-46ad-ab75-0ab7f7ffd778 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.175699 Aug 08 13:40:15.301263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 257/524] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:15 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:16.326794 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:16.327402 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:16.334458 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:16.335334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:16.335771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:16.336485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:16.336931 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:16.337352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:16.522984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:16.534491 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:16.536664 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:16.538420 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-971976b8-b11c-40e6-8410-052383166f10 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.216149 Aug 08 13:40:16.551114 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 268/525] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:16 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:17.563299 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:17.565931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:17.572811 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:17.573308 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:17.573744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:17.574583 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:17.574912 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:17.575394 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:17.736972 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:17.745561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:17.747023 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:17.748239 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b7e23b19-5cf9-45c4-93da-341daa117d7f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.190256 Aug 08 13:40:17.748897 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 258/526] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:17 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:40:18.771779 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:18.772402 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:18.779035 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:18.779561 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:18.779992 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:18.780647 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:18.781095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:18.781514 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:18.929515 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:18.938606 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:18.940308 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:18.941579 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0dfd41a1-8e4c-4b67-9f95-f02efc7b5964 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.174016 Aug 08 13:40:18.942595 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 269/527] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:18 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:19.757967 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b5a669a7-e76a-4c9e-b070-3936e3dca876 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33e1468f-72b3-436a-953b-0ca38edce759"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:40:19.761947 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b5a669a7-e76a-4c9e-b070-3936e3dca876 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:19.769796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b5a669a7-e76a-4c9e-b070-3936e3dca876 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:19.770413 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b5a669a7-e76a-4c9e-b070-3936e3dca876 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:19.770850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b5a669a7-e76a-4c9e-b070-3936e3dca876 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:19.771626 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b5a669a7-e76a-4c9e-b070-3936e3dca876 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:19.772229 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b5a669a7-e76a-4c9e-b070-3936e3dca876 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:19.772872 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b5a669a7-e76a-4c9e-b070-3936e3dca876 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:19.965056 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:19.965661 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:19.972330 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:19.972803 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:19.973234 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:19.973925 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:19.974365 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:19.974784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:20.126912 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:20.136263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:20.138059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:20.139328 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d5d94002-0f72-4874-b7c5-33e1348c487a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.178242 Aug 08 13:40:20.139925 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 270/528] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:19 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:21.162884 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:21.167180 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:21.171741 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:21.172233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:21.172661 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:21.173360 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:21.173806 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:21.174220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:21.313241 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:21.327112 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:21.329600 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:21.331503 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-737bd860-59ae-4158-8a5e-7e725ccaba35 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.173208 Aug 08 13:40:21.332704 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 271/529] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:21 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:40:22.360019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:22.360767 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:22.367612 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:22.368087 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:22.368517 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:22.369202 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:22.369637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:22.370057 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:22.507246 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:22.515885 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:22.517414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:22.518602 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-dacb7248-8f3d-42e2-b1d3-ab3f35df38ec tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.163701 Aug 08 13:40:22.519180 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 272/530] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:22 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:23.542937 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:23.543777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:23.550652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:23.551032 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:23.551542 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:23.552441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:23.552661 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:23.553101 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:23.723908 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:23.733429 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:23.734941 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:23.736169 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-313f5aaf-2dcc-4afd-879e-04d83013745b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.197279 Aug 08 13:40:23.736947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 273/531] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:23 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:24.759726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:24.760488 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:24.767611 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:24.768464 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:24.769175 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:24.769941 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:24.770399 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:24.770773 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:24.909838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:24.919341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:24.920843 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:24.922039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b4f917d6-896f-4e36-8e17-f1f4a7afdfd2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.166349 Aug 08 13:40:24.922605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 274/532] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:24 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:25.945355 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:25.946299 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:25.948489 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:40:25.954738 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:25.955274 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:25.955725 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:25.956441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:25.956879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:25.957311 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:26.112954 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:26.121698 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:26.123202 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:26.124388 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-663bf920-3c97-4545-acdb-df492b146128 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.183101 Aug 08 13:40:26.124936 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 275/533] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:25 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:27.161864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:27.162558 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:27.169445 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:27.169921 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:27.170343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:27.171031 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:27.171508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:27.171923 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:27.323786 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:27.337100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:27.339507 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:27.341245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b8d100b1-0e4c-4e43-8c51-daa52c57e5b7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.183139 Aug 08 13:40:27.341919 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 276/534] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:27 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:28.370408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:28.371115 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:28.377918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:28.378400 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:28.378828 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:28.379568 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:28.380020 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:28.380451 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:28.527259 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:28.536264 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:28.537810 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:28.538979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-06eb53ff-4742-4bff-bce7-66ec5f5730da tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.174711 Aug 08 13:40:28.539570 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 277/535] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:28 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:29.562618 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:29.563360 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:29.570357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:29.570846 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:29.571314 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:29.572014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:29.572464 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:29.572887 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:29.593572 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:40:29.722171 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:29.732607 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:29.734117 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:29.735330 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-29c0eb98-064c-4e2c-8154-78c73590e182 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.176804 Aug 08 13:40:29.735898 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 278/536] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:29 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:40:29.766649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=31 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:40:29.863959 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=27,nova_cell1:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:40:30.761560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:30.762483 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:30.772727 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:30.773211 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:30.773635 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:30.774329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:30.774755 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:30.775191 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:30.922390 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:30.932528 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:30.934174 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:30.935446 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-989e76bb-1d94-466e-9ff4-8ace1d72cc21 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.179985 Aug 08 13:40:30.936015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 279/537] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:30 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:31.745389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b5a669a7-e76a-4c9e-b070-3936e3dca876 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.991828 Aug 08 13:40:31.749322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 259/538] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:40:19 2022] POST /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments => generated 194 bytes in 11997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:40:31.958273 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:31.959599 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:31.967134 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:31.967511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:31.967929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:31.968676 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:31.969131 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:31.969554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:32.111433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:32.120635 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:32.122116 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:32.123344 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3f9cb9b8-4048-4f27-9102-4eb1574f9a56 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.168961 Aug 08 13:40:32.123899 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 280/539] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:31 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:32.542646 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 08 13:40:32.542905 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Mon Aug 8 13:40:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 13:40:33.149348 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:33.150302 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:33.159792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:33.160274 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:33.160704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:33.161446 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:33.161878 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:33.162297 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:33.306411 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:33.317260 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:33.319946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:33.321183 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6fe5bfc6-d1ea-4c7d-966f-b730327ad7a5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.177750 Aug 08 13:40:33.321754 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 260/540] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:33 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:34.347120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:34.347804 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:34.354909 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:34.355840 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:34.356345 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:34.357082 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:34.357551 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:34.357959 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:34.505912 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:34.514712 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:34.516242 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:34.517390 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-73ed69be-4751-43de-8978-4668778b9841 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.175882 Aug 08 13:40:34.517966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 281/541] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:34 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:35.541060 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:35.541696 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:35.548524 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:35.549001 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:35.549430 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:35.550120 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:35.550564 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:35.550981 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:35.693837 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:35.702647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:35.704158 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:35.705319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-68939cdf-13c4-442e-9bcc-f065b16f6844 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.168323 Aug 08 13:40:35.705912 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 261/542] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:35 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:36.591184 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 08 13:40:36.591891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Mon Aug 8 13:40:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 13:40:36.732494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:36.733114 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:36.741475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:36.741962 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:36.742395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:36.743111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:36.743589 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:36.744015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:36.884968 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:36.893983 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:36.895528 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:36.896934 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3835914e-9907-4691-b4ed-02456fc6ddc7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.171430 Aug 08 13:40:36.897498 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 282/543] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:36 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:37.924425 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:37.925124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:37.935616 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:37.936322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:37.936978 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:37.938134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:37.938654 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:37.939311 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:38.089241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:38.098415 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:38.100151 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:38.101887 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-44a9508b-4ec6-406d-a07f-99173b423eaf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.183381 Aug 08 13:40:38.101887 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 262/544] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:37 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:39.128592 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:39.129392 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:39.140430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:39.141175 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:39.141852 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:39.142941 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:39.143632 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:39.144336 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:39.301548 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:39.310684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:39.313486 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:39.314841 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8e39a3e2-9bff-4e1b-b541-802b43a2cab9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.192296 Aug 08 13:40:39.315621 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 283/545] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:39 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:40.341845 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:40.342891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:40.352852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:40.353330 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:40.353798 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:40.354522 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:40.355426 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:40.355765 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:40.408008 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-690678f9-77ed-46c8-b864-39c89a990e03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:40:40.410412 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-690678f9-77ed-46c8-b864-39c89a990e03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:40.417441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-690678f9-77ed-46c8-b864-39c89a990e03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:40.417924 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-690678f9-77ed-46c8-b864-39c89a990e03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:40.418577 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-690678f9-77ed-46c8-b864-39c89a990e03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:40.419317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-690678f9-77ed-46c8-b864-39c89a990e03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:40.419764 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-690678f9-77ed-46c8-b864-39c89a990e03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:40.420191 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-690678f9-77ed-46c8-b864-39c89a990e03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:40.447769 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-690678f9-77ed-46c8-b864-39c89a990e03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lazy-loading 'flavor' on Instance uuid 5f52d43d-f702-4083-8da1-ace76450a04d {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:40:40.509343 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:40.529665 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:40.533433 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:40.535673 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-29523a55-7a64-4df8-9f57-8dbbe8273d16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.200671 Aug 08 13:40:40.551513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 263/546] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:40 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:40.612195 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-690678f9-77ed-46c8-b864-39c89a990e03 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/action" status: 200 len: 32 microversion: 2.1 time: 0.207873 Aug 08 13:40:40.613364 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 284/547] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:40:40 2022] POST /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 13:40:40.626096 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-30dc7e20-0d18-4b39-9016-0e2919640544 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:40.627200 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-30dc7e20-0d18-4b39-9016-0e2919640544 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:40.635695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30dc7e20-0d18-4b39-9016-0e2919640544 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:40.637070 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30dc7e20-0d18-4b39-9016-0e2919640544 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:40.637706 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30dc7e20-0d18-4b39-9016-0e2919640544 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:40.639323 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30dc7e20-0d18-4b39-9016-0e2919640544 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:40.640055 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30dc7e20-0d18-4b39-9016-0e2919640544 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:40.640473 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-30dc7e20-0d18-4b39-9016-0e2919640544 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:40.787980 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-30dc7e20-0d18-4b39-9016-0e2919640544 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:40.797555 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-30dc7e20-0d18-4b39-9016-0e2919640544 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.175911 Aug 08 13:40:40.798134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 264/548] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:40 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:40:41.567217 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:41.568319 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:41.576210 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:41.576775 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:41.577400 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:41.578260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:41.578778 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:41.579421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:41.734164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:41.744365 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:41.746024 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:41.747272 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e83a25c0-5882-4e57-b2b7-5d8804cf76cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.185946 Aug 08 13:40:41.747837 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 285/549] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:41 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:41.819508 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3c09540a-8332-4a4b-a7f0-e4201a7b1cf8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:41.820260 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3c09540a-8332-4a4b-a7f0-e4201a7b1cf8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:41.827517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3c09540a-8332-4a4b-a7f0-e4201a7b1cf8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:41.828009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3c09540a-8332-4a4b-a7f0-e4201a7b1cf8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:41.828431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3c09540a-8332-4a4b-a7f0-e4201a7b1cf8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:41.829153 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3c09540a-8332-4a4b-a7f0-e4201a7b1cf8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:41.829607 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3c09540a-8332-4a4b-a7f0-e4201a7b1cf8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:41.830038 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3c09540a-8332-4a4b-a7f0-e4201a7b1cf8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:41.980604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3c09540a-8332-4a4b-a7f0-e4201a7b1cf8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:41.989027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3c09540a-8332-4a4b-a7f0-e4201a7b1cf8 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.173618 Aug 08 13:40:41.989609 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 265/550] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:41 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:42.600794 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-b5564737-d47a-4580-b08b-48bbabd670dd req-2b3a43d5-ef33-49fd-88b3-201aee886d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b337a957-cd21-4f51-aa36-f64ad24aee7c", "name": "network-vif-plugged", "status": "completed", "tag": "9caada1c-52b2-4c87-b709-be921f77a3b5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:40:42.614805 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-b5564737-d47a-4580-b08b-48bbabd670dd req-2b3a43d5-ef33-49fd-88b3-201aee886d50 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:42.615484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-b5564737-d47a-4580-b08b-48bbabd670dd req-2b3a43d5-ef33-49fd-88b3-201aee886d50 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:42.615985 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-b5564737-d47a-4580-b08b-48bbabd670dd req-2b3a43d5-ef33-49fd-88b3-201aee886d50 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:42.633863 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-b5564737-d47a-4580-b08b-48bbabd670dd req-2b3a43d5-ef33-49fd-88b3-201aee886d50 service nova] Creating event network-vif-plugged:9caada1c-52b2-4c87-b709-be921f77a3b5 for instance b337a957-cd21-4f51-aa36-f64ad24aee7c on hv-cinder-85199 Aug 08 13:40:42.640033 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-b5564737-d47a-4580-b08b-48bbabd670dd req-2b3a43d5-ef33-49fd-88b3-201aee886d50 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043112 Aug 08 13:40:42.640602 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 286/551] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:40:42.772619 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:42.773312 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:42.780504 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:42.780999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:42.781434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:42.782157 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:42.782610 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:42.783034 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:42.936630 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:42.946723 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:42.948308 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:42.949528 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e76d6972-18b9-44ed-91a5-3ff894ac7a9a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.181089 Aug 08 13:40:42.950146 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 266/552] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:42 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:43.011070 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-884693a3-f37e-4399-b620-1af2ea13d05a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:43.011825 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-884693a3-f37e-4399-b620-1af2ea13d05a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:43.019247 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-884693a3-f37e-4399-b620-1af2ea13d05a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:43.019754 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-884693a3-f37e-4399-b620-1af2ea13d05a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:43.020199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-884693a3-f37e-4399-b620-1af2ea13d05a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:43.020943 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-884693a3-f37e-4399-b620-1af2ea13d05a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:43.021628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-884693a3-f37e-4399-b620-1af2ea13d05a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:43.022095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-884693a3-f37e-4399-b620-1af2ea13d05a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:43.190739 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-884693a3-f37e-4399-b620-1af2ea13d05a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:43.199429 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-884693a3-f37e-4399-b620-1af2ea13d05a tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.192722 Aug 08 13:40:43.200020 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 287/553] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:43 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:43.974020 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:43.974761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:43.982033 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:43.982514 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:43.983028 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:43.983666 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:43.984095 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:43.984508 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:44.126450 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:44.135309 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:44.136802 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:44.137997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7db1a57f-a278-4d03-86cb-ed5209364528 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.168519 Aug 08 13:40:44.138569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 267/554] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:43 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:44.221311 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-44dd7a88-edcc-42c9-888d-202a4ed128dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:44.221932 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-44dd7a88-edcc-42c9-888d-202a4ed128dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:44.228817 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-44dd7a88-edcc-42c9-888d-202a4ed128dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:44.229210 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-44dd7a88-edcc-42c9-888d-202a4ed128dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:44.229612 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-44dd7a88-edcc-42c9-888d-202a4ed128dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:44.230684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-44dd7a88-edcc-42c9-888d-202a4ed128dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:44.231120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-44dd7a88-edcc-42c9-888d-202a4ed128dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:44.231562 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-44dd7a88-edcc-42c9-888d-202a4ed128dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:44.374392 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-44dd7a88-edcc-42c9-888d-202a4ed128dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:44.383370 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-44dd7a88-edcc-42c9-888d-202a4ed128dd tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.165907 Aug 08 13:40:44.383965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 288/555] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:44 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:45.161869 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:45.162799 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:45.171983 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:45.172517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:45.172943 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:45.173641 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:45.174073 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:45.174647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:45.315544 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:45.325397 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:45.326899 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:45.328118 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8d061304-c4f5-4083-be1d-55bd932202de tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1808 microversion: 2.20 time: 0.170307 Aug 08 13:40:45.328692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 268/556] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:45 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:45.407584 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ed69d428-b623-495e-8b62-3c1eaaeb3804 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:45.408237 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ed69d428-b623-495e-8b62-3c1eaaeb3804 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:45.414989 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed69d428-b623-495e-8b62-3c1eaaeb3804 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:45.415433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed69d428-b623-495e-8b62-3c1eaaeb3804 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:45.415856 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed69d428-b623-495e-8b62-3c1eaaeb3804 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:45.416546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed69d428-b623-495e-8b62-3c1eaaeb3804 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:45.416998 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed69d428-b623-495e-8b62-3c1eaaeb3804 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:45.417412 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed69d428-b623-495e-8b62-3c1eaaeb3804 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:45.560917 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ed69d428-b623-495e-8b62-3c1eaaeb3804 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:45.569613 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ed69d428-b623-495e-8b62-3c1eaaeb3804 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.165832 Aug 08 13:40:45.570177 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 289/557] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:45 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:46.352389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:46.353019 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:46.360139 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:46.360628 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:46.361036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:46.361789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:46.362229 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:46.362904 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:46.498649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:46.507461 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:46.508948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:46.510111 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-dd655f19-2d0a-4a8e-b2d6-f7c1bcccf7e2 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1795 microversion: 2.20 time: 0.162057 Aug 08 13:40:46.510662 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 269/558] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:40:46 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1795 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:40:46.591793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9cfb846d-aecc-436b-bef5-20abcc7b79c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:46.592403 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9cfb846d-aecc-436b-bef5-20abcc7b79c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:46.599367 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cfb846d-aecc-436b-bef5-20abcc7b79c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:46.599846 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cfb846d-aecc-436b-bef5-20abcc7b79c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:46.600271 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cfb846d-aecc-436b-bef5-20abcc7b79c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:46.600960 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cfb846d-aecc-436b-bef5-20abcc7b79c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:46.601395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cfb846d-aecc-436b-bef5-20abcc7b79c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:46.601810 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cfb846d-aecc-436b-bef5-20abcc7b79c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:46.744387 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9cfb846d-aecc-436b-bef5-20abcc7b79c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:46.753182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9cfb846d-aecc-436b-bef5-20abcc7b79c6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.165152 Aug 08 13:40:46.753671 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 290/559] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:46 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:47.774802 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-620cc6b5-15fa-4ad0-a5a5-1db02df436a5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:47.775473 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-620cc6b5-15fa-4ad0-a5a5-1db02df436a5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:47.782207 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-620cc6b5-15fa-4ad0-a5a5-1db02df436a5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:47.782809 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-620cc6b5-15fa-4ad0-a5a5-1db02df436a5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:47.783344 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-620cc6b5-15fa-4ad0-a5a5-1db02df436a5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:47.784064 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-620cc6b5-15fa-4ad0-a5a5-1db02df436a5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:47.784511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-620cc6b5-15fa-4ad0-a5a5-1db02df436a5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:47.784927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-620cc6b5-15fa-4ad0-a5a5-1db02df436a5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:47.917998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-620cc6b5-15fa-4ad0-a5a5-1db02df436a5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:47.926370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-620cc6b5-15fa-4ad0-a5a5-1db02df436a5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.155485 Aug 08 13:40:47.927058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 270/560] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:47 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:48.948344 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6d88686a-3376-4995-8677-e2e3e22a034d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:48.949001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6d88686a-3376-4995-8677-e2e3e22a034d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:48.955858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d88686a-3376-4995-8677-e2e3e22a034d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:48.956639 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d88686a-3376-4995-8677-e2e3e22a034d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:48.957118 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d88686a-3376-4995-8677-e2e3e22a034d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:48.957834 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d88686a-3376-4995-8677-e2e3e22a034d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:48.958282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d88686a-3376-4995-8677-e2e3e22a034d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:48.958740 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6d88686a-3376-4995-8677-e2e3e22a034d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:49.098364 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6d88686a-3376-4995-8677-e2e3e22a034d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:49.107263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6d88686a-3376-4995-8677-e2e3e22a034d tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.162806 Aug 08 13:40:49.107852 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 291/561] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:48 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:50.129274 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-529de2bf-89dc-4af2-9356-ab995d68e34f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:50.129871 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-529de2bf-89dc-4af2-9356-ab995d68e34f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:50.138205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-529de2bf-89dc-4af2-9356-ab995d68e34f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:50.138689 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-529de2bf-89dc-4af2-9356-ab995d68e34f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:50.139149 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-529de2bf-89dc-4af2-9356-ab995d68e34f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:50.139879 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-529de2bf-89dc-4af2-9356-ab995d68e34f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:50.140331 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-529de2bf-89dc-4af2-9356-ab995d68e34f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:50.140753 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-529de2bf-89dc-4af2-9356-ab995d68e34f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:50.274567 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-529de2bf-89dc-4af2-9356-ab995d68e34f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:50.283657 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-529de2bf-89dc-4af2-9356-ab995d68e34f tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.158331 Aug 08 13:40:50.284257 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 271/562] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:50 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:51.307736 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-87ef2697-dd0d-4cce-9b56-a8bbe24d7550 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:51.309053 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-87ef2697-dd0d-4cce-9b56-a8bbe24d7550 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:51.320409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-87ef2697-dd0d-4cce-9b56-a8bbe24d7550 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:51.320409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-87ef2697-dd0d-4cce-9b56-a8bbe24d7550 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:51.320409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-87ef2697-dd0d-4cce-9b56-a8bbe24d7550 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:51.320409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-87ef2697-dd0d-4cce-9b56-a8bbe24d7550 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:51.320927 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-87ef2697-dd0d-4cce-9b56-a8bbe24d7550 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:51.320927 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-87ef2697-dd0d-4cce-9b56-a8bbe24d7550 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:51.465763 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-87ef2697-dd0d-4cce-9b56-a8bbe24d7550 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:51.474364 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-87ef2697-dd0d-4cce-9b56-a8bbe24d7550 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.172520 Aug 08 13:40:51.474938 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 292/563] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:51 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:52.499238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9d3a6b73-f300-4c9c-a27e-2ddf98534db6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:52.499886 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9d3a6b73-f300-4c9c-a27e-2ddf98534db6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:52.507715 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9d3a6b73-f300-4c9c-a27e-2ddf98534db6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:52.508229 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9d3a6b73-f300-4c9c-a27e-2ddf98534db6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:52.508665 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9d3a6b73-f300-4c9c-a27e-2ddf98534db6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:52.509359 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9d3a6b73-f300-4c9c-a27e-2ddf98534db6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:52.509809 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9d3a6b73-f300-4c9c-a27e-2ddf98534db6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:52.510229 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9d3a6b73-f300-4c9c-a27e-2ddf98534db6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:52.661856 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9d3a6b73-f300-4c9c-a27e-2ddf98534db6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:52.670846 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9d3a6b73-f300-4c9c-a27e-2ddf98534db6 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.175422 Aug 08 13:40:52.671499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 272/564] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:52 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:53.693040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-849ae0cf-ffe1-4db9-92e8-727d8553dce4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:53.693637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-849ae0cf-ffe1-4db9-92e8-727d8553dce4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:53.702904 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-849ae0cf-ffe1-4db9-92e8-727d8553dce4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:53.703793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-849ae0cf-ffe1-4db9-92e8-727d8553dce4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:53.704319 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-849ae0cf-ffe1-4db9-92e8-727d8553dce4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:53.705227 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-849ae0cf-ffe1-4db9-92e8-727d8553dce4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:53.705750 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-849ae0cf-ffe1-4db9-92e8-727d8553dce4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:53.706209 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-849ae0cf-ffe1-4db9-92e8-727d8553dce4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:53.858007 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-849ae0cf-ffe1-4db9-92e8-727d8553dce4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:53.861722 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:40:53.867114 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-849ae0cf-ffe1-4db9-92e8-727d8553dce4 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.178077 Aug 08 13:40:53.867689 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 293/565] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:53 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:40:54.892089 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-63ea7c76-c2b5-4801-97ad-30e7e0fbd7fe tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:54.892982 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-63ea7c76-c2b5-4801-97ad-30e7e0fbd7fe tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:54.900370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63ea7c76-c2b5-4801-97ad-30e7e0fbd7fe tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:54.900858 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63ea7c76-c2b5-4801-97ad-30e7e0fbd7fe tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:54.901289 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63ea7c76-c2b5-4801-97ad-30e7e0fbd7fe tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:54.901991 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63ea7c76-c2b5-4801-97ad-30e7e0fbd7fe tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:54.902440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63ea7c76-c2b5-4801-97ad-30e7e0fbd7fe tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:54.902863 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63ea7c76-c2b5-4801-97ad-30e7e0fbd7fe tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:55.052333 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-63ea7c76-c2b5-4801-97ad-30e7e0fbd7fe tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:55.063291 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-63ea7c76-c2b5-4801-97ad-30e7e0fbd7fe tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.176896 Aug 08 13:40:55.063886 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 273/566] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:54 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:56.087048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-499c0506-2695-402a-8899-c94eaed426a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:56.087712 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-499c0506-2695-402a-8899-c94eaed426a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:56.090521 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=38 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:40:56.096350 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-499c0506-2695-402a-8899-c94eaed426a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:56.096833 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-499c0506-2695-402a-8899-c94eaed426a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:56.097281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-499c0506-2695-402a-8899-c94eaed426a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:56.097993 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-499c0506-2695-402a-8899-c94eaed426a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:56.098442 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-499c0506-2695-402a-8899-c94eaed426a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:56.098954 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-499c0506-2695-402a-8899-c94eaed426a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:56.246278 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-499c0506-2695-402a-8899-c94eaed426a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:56.254695 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-499c0506-2695-402a-8899-c94eaed426a1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.173513 Aug 08 13:40:56.255349 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 294/567] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:56 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:57.278173 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8385bbf9-848b-49e0-bcae-ec15929a1e91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:57.278818 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8385bbf9-848b-49e0-bcae-ec15929a1e91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:57.285683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8385bbf9-848b-49e0-bcae-ec15929a1e91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:57.286178 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8385bbf9-848b-49e0-bcae-ec15929a1e91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:57.286688 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8385bbf9-848b-49e0-bcae-ec15929a1e91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:57.287452 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8385bbf9-848b-49e0-bcae-ec15929a1e91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:57.287883 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8385bbf9-848b-49e0-bcae-ec15929a1e91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:57.288312 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8385bbf9-848b-49e0-bcae-ec15929a1e91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:57.442966 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8385bbf9-848b-49e0-bcae-ec15929a1e91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:57.451671 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8385bbf9-848b-49e0-bcae-ec15929a1e91 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.177439 Aug 08 13:40:57.452272 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 274/568] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:57 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:40:58.477448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b8fed100-cb18-4269-9315-35f726e278e9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:58.478407 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b8fed100-cb18-4269-9315-35f726e278e9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:58.489449 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8fed100-cb18-4269-9315-35f726e278e9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:58.490152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8fed100-cb18-4269-9315-35f726e278e9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:58.490585 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8fed100-cb18-4269-9315-35f726e278e9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:58.491329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8fed100-cb18-4269-9315-35f726e278e9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:58.491778 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8fed100-cb18-4269-9315-35f726e278e9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:58.492200 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b8fed100-cb18-4269-9315-35f726e278e9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:58.646273 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b8fed100-cb18-4269-9315-35f726e278e9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:58.654915 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b8fed100-cb18-4269-9315-35f726e278e9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.183759 Aug 08 13:40:58.655522 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 295/569] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:58 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:40:59.676439 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-88ec4dc7-78f2-4c24-9fcf-ba3432a108ef tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:40:59.677104 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-88ec4dc7-78f2-4c24-9fcf-ba3432a108ef tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:40:59.683985 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ec4dc7-78f2-4c24-9fcf-ba3432a108ef tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:59.684465 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ec4dc7-78f2-4c24-9fcf-ba3432a108ef tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:59.684893 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ec4dc7-78f2-4c24-9fcf-ba3432a108ef tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:59.685586 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ec4dc7-78f2-4c24-9fcf-ba3432a108ef tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:40:59.686030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ec4dc7-78f2-4c24-9fcf-ba3432a108ef tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:40:59.686447 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-88ec4dc7-78f2-4c24-9fcf-ba3432a108ef tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:40:59.690636 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:40:59.832736 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-88ec4dc7-78f2-4c24-9fcf-ba3432a108ef tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:40:59.845223 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-88ec4dc7-78f2-4c24-9fcf-ba3432a108ef tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.172367 Aug 08 13:40:59.846060 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 275/570] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:40:59 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:00.872779 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c1144099-8a03-4be1-8a34-e41b0aff22eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:00.873426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c1144099-8a03-4be1-8a34-e41b0aff22eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:00.880427 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1144099-8a03-4be1-8a34-e41b0aff22eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:00.880910 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1144099-8a03-4be1-8a34-e41b0aff22eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:00.881361 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1144099-8a03-4be1-8a34-e41b0aff22eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:00.882094 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1144099-8a03-4be1-8a34-e41b0aff22eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:00.882535 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1144099-8a03-4be1-8a34-e41b0aff22eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:00.882988 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1144099-8a03-4be1-8a34-e41b0aff22eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:01.028697 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c1144099-8a03-4be1-8a34-e41b0aff22eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:01.039587 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c1144099-8a03-4be1-8a34-e41b0aff22eb tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1735 microversion: 2.1 time: 0.170873 Aug 08 13:41:01.040142 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 296/571] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:00 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:02.061269 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-de0d657f-3e43-42d5-9ca4-07110463140e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:02.061906 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-de0d657f-3e43-42d5-9ca4-07110463140e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:02.064287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=33 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:02.070032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-de0d657f-3e43-42d5-9ca4-07110463140e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:02.070524 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-de0d657f-3e43-42d5-9ca4-07110463140e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:02.071156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-de0d657f-3e43-42d5-9ca4-07110463140e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:02.071676 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-de0d657f-3e43-42d5-9ca4-07110463140e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:02.072141 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-de0d657f-3e43-42d5-9ca4-07110463140e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:02.072559 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-de0d657f-3e43-42d5-9ca4-07110463140e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:02.209053 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-de0d657f-3e43-42d5-9ca4-07110463140e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:02.217694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-de0d657f-3e43-42d5-9ca4-07110463140e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1715 microversion: 2.1 time: 0.160305 Aug 08 13:41:02.218533 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 276/572] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:02 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:02.287849 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:02.288503 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:02.295878 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:02.296375 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:02.296802 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:02.297521 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:02.297959 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:02.298378 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:02.431494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] HTTP exception thrown: Cannot 'detach_volume' instance 5f52d43d-f702-4083-8da1-ace76450a04d while it is in vm_state rescued Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Request method failure captured: Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: DELETE /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments/33e1468f-72b3-436a-953b-0ca38edce759 HTTP/1.1 Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REf1Ea14AYR1pE2a6K4N54fc0_x21TT0v6rOqtzgzhFTlqzH2mLPOhcT2JRzQ__W3s8-mQbJ-2jCAvD7htLjrZXdatV8tQuLIFbwXboRqq9yI-tUt4OQZMNTlEmgJXenIgfvcMxbcNgSLDSG6kCzX_3jRFF8WtZW-BF7nLZaWhtqiA Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: f90db8c721374e0fb3a037661b3d9fe0 Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:41:02.433145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f90db8c721374e0fb3a037661b3d9fe0"}]}] Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: f90db8c721374e0fb3a037661b3d9fe0 Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-ServerRescueNegativeTestJSON-1645977264-project Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: 518d6948777944fd8214dc6d778a9a02 Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1645977264-project Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:41:02.434735 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Cannot 'detach_volume' instance 5f52d43d-f702-4083-8da1-ace76450a04d while it is in vm_state rescued Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'server_id': '5f52d43d-f702-4083-8da1-ace76450a04d', 'id': '33e1468f-72b3-436a-953b-0ca38edce759'} Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5f52d43d-f702-4083-8da1-ace76450a04d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:41:02.436026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5f52d43d-f702-4083-8da1-ace76450a04d while it is in vm_state rescued Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5f52d43d-f702-4083-8da1-ace76450a04d while it is in vm_state rescued Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:41:02.438260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Returning 409 to user: Cannot 'detach_volume' instance 5f52d43d-f702-4083-8da1-ace76450a04d while it is in vm_state rescued {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:41:02.439643 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-dcadf20a-af98-491e-85f2-8221dd9591b1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments/33e1468f-72b3-436a-953b-0ca38edce759" status: 409 len: 152 microversion: 2.1 time: 0.151165 Aug 08 13:41:02.439643 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 297/573] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:41:02 2022] DELETE /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments/33e1468f-72b3-436a-953b-0ca38edce759 => generated 152 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 13:41:02.444104 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-63e9cd41-fd3e-4736-aa8d-2996c77b7380 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:02.444625 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-63e9cd41-fd3e-4736-aa8d-2996c77b7380 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:02.451246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63e9cd41-fd3e-4736-aa8d-2996c77b7380 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:02.451736 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63e9cd41-fd3e-4736-aa8d-2996c77b7380 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:02.452168 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63e9cd41-fd3e-4736-aa8d-2996c77b7380 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:02.452880 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63e9cd41-fd3e-4736-aa8d-2996c77b7380 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:02.453329 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63e9cd41-fd3e-4736-aa8d-2996c77b7380 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:02.453746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-63e9cd41-fd3e-4736-aa8d-2996c77b7380 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:02.529262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-63e9cd41-fd3e-4736-aa8d-2996c77b7380 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "POST /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/action" status: 202 len: 0 microversion: 2.1 time: 0.088520 Aug 08 13:41:02.530050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 277/574] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:41:02 2022] POST /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:41:02.538955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-62391c2d-e41b-4afa-99d5-c0695ccd0d71 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:02.539599 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-62391c2d-e41b-4afa-99d5-c0695ccd0d71 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:02.546758 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-62391c2d-e41b-4afa-99d5-c0695ccd0d71 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:02.547320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-62391c2d-e41b-4afa-99d5-c0695ccd0d71 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:02.547787 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-62391c2d-e41b-4afa-99d5-c0695ccd0d71 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:02.548519 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-62391c2d-e41b-4afa-99d5-c0695ccd0d71 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:02.548986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-62391c2d-e41b-4afa-99d5-c0695ccd0d71 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:02.549404 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-62391c2d-e41b-4afa-99d5-c0695ccd0d71 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:02.696245 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-62391c2d-e41b-4afa-99d5-c0695ccd0d71 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:02.711289 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-62391c2d-e41b-4afa-99d5-c0695ccd0d71 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1723 microversion: 2.1 time: 0.176081 Aug 08 13:41:02.712372 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 298/575] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:02 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:03.739603 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-dd65d9fd-ddb8-4563-afe6-9d92fba48f07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:03.740710 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-dd65d9fd-ddb8-4563-afe6-9d92fba48f07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:03.747789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd65d9fd-ddb8-4563-afe6-9d92fba48f07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:03.748271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd65d9fd-ddb8-4563-afe6-9d92fba48f07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:03.748689 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd65d9fd-ddb8-4563-afe6-9d92fba48f07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:03.749393 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd65d9fd-ddb8-4563-afe6-9d92fba48f07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:03.749808 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd65d9fd-ddb8-4563-afe6-9d92fba48f07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:03.750255 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dd65d9fd-ddb8-4563-afe6-9d92fba48f07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:03.890888 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dd65d9fd-ddb8-4563-afe6-9d92fba48f07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:03.900201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-dd65d9fd-ddb8-4563-afe6-9d92fba48f07 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1723 microversion: 2.1 time: 0.168046 Aug 08 13:41:03.900934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 278/576] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:03 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:04.922765 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e49665b7-37e4-4b31-bb32-6a9bb714fa24 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:04.923459 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e49665b7-37e4-4b31-bb32-6a9bb714fa24 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:04.930225 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e49665b7-37e4-4b31-bb32-6a9bb714fa24 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:04.930683 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e49665b7-37e4-4b31-bb32-6a9bb714fa24 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:04.931136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e49665b7-37e4-4b31-bb32-6a9bb714fa24 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:04.931830 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e49665b7-37e4-4b31-bb32-6a9bb714fa24 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:04.932274 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e49665b7-37e4-4b31-bb32-6a9bb714fa24 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:04.932697 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e49665b7-37e4-4b31-bb32-6a9bb714fa24 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:05.073573 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e49665b7-37e4-4b31-bb32-6a9bb714fa24 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:05.083116 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e49665b7-37e4-4b31-bb32-6a9bb714fa24 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1723 microversion: 2.1 time: 0.164329 Aug 08 13:41:05.083690 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 299/577] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:04 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:06.104184 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2ad9c04d-434a-438f-b416-3cda33ddbb29 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:06.104773 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2ad9c04d-434a-438f-b416-3cda33ddbb29 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:06.111700 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad9c04d-434a-438f-b416-3cda33ddbb29 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:06.112178 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad9c04d-434a-438f-b416-3cda33ddbb29 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:06.112600 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad9c04d-434a-438f-b416-3cda33ddbb29 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:06.113283 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad9c04d-434a-438f-b416-3cda33ddbb29 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:06.113720 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad9c04d-434a-438f-b416-3cda33ddbb29 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:06.114132 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad9c04d-434a-438f-b416-3cda33ddbb29 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:06.247416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2ad9c04d-434a-438f-b416-3cda33ddbb29 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:06.255819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2ad9c04d-434a-438f-b416-3cda33ddbb29 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1729 microversion: 2.1 time: 0.155976 Aug 08 13:41:06.256400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 279/578] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:06 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:06.281024 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0356f37d-9f6d-4fc9-8782-fa1f461d3d5c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:06.281582 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0356f37d-9f6d-4fc9-8782-fa1f461d3d5c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:06.289249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0356f37d-9f6d-4fc9-8782-fa1f461d3d5c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:06.290130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0356f37d-9f6d-4fc9-8782-fa1f461d3d5c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:06.290377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0356f37d-9f6d-4fc9-8782-fa1f461d3d5c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:06.291113 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0356f37d-9f6d-4fc9-8782-fa1f461d3d5c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:06.291556 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0356f37d-9f6d-4fc9-8782-fa1f461d3d5c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:06.291973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0356f37d-9f6d-4fc9-8782-fa1f461d3d5c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:06.378486 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0356f37d-9f6d-4fc9-8782-fa1f461d3d5c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101164 Aug 08 13:41:06.379534 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 300/579] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 13:41:06 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:07.414825 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-3b0123c6-63ca-4b71-bc02-495797d6daf7 req-5a2cd5c0-af1b-4a7c-ab81-291efb56b9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f52d43d-f702-4083-8da1-ace76450a04d", "tag": "d64f2955-ff2d-41e6-bb65-c24de3c861ef"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:07.425079 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-3b0123c6-63ca-4b71-bc02-495797d6daf7 req-5a2cd5c0-af1b-4a7c-ab81-291efb56b9e7 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:07.425470 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-3b0123c6-63ca-4b71-bc02-495797d6daf7 req-5a2cd5c0-af1b-4a7c-ab81-291efb56b9e7 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:07.425895 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-3b0123c6-63ca-4b71-bc02-495797d6daf7 req-5a2cd5c0-af1b-4a7c-ab81-291efb56b9e7 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:07.438509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-3b0123c6-63ca-4b71-bc02-495797d6daf7 req-5a2cd5c0-af1b-4a7c-ab81-291efb56b9e7 service nova] Creating event network-changed:d64f2955-ff2d-41e6-bb65-c24de3c861ef for instance 5f52d43d-f702-4083-8da1-ace76450a04d on hv-cinder-85199 Aug 08 13:41:07.444272 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-3b0123c6-63ca-4b71-bc02-495797d6daf7 req-5a2cd5c0-af1b-4a7c-ab81-291efb56b9e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121894 Aug 08 13:41:07.445017 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 280/580] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:09.462426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-5e0e0858-d724-41bb-bd6f-ecca4f737b3f req-00e8ec68-9e85-45b0-b38d-edee3ce4da95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f52d43d-f702-4083-8da1-ace76450a04d", "tag": "d64f2955-ff2d-41e6-bb65-c24de3c861ef"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:09.472338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-5e0e0858-d724-41bb-bd6f-ecca4f737b3f req-00e8ec68-9e85-45b0-b38d-edee3ce4da95 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:09.472811 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-5e0e0858-d724-41bb-bd6f-ecca4f737b3f req-00e8ec68-9e85-45b0-b38d-edee3ce4da95 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:09.473232 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-5e0e0858-d724-41bb-bd6f-ecca4f737b3f req-00e8ec68-9e85-45b0-b38d-edee3ce4da95 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:09.484928 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-5e0e0858-d724-41bb-bd6f-ecca4f737b3f req-00e8ec68-9e85-45b0-b38d-edee3ce4da95 service nova] Creating event network-changed:d64f2955-ff2d-41e6-bb65-c24de3c861ef for instance 5f52d43d-f702-4083-8da1-ace76450a04d on hv-cinder-85199 Aug 08 13:41:09.490169 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-5e0e0858-d724-41bb-bd6f-ecca4f737b3f req-00e8ec68-9e85-45b0-b38d-edee3ce4da95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032247 Aug 08 13:41:09.490746 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 301/581] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:11.034147 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7dc12d85-f588-4d6f-bada-302e7ff8215a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:11.034692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7dc12d85-f588-4d6f-bada-302e7ff8215a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:11.041438 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dc12d85-f588-4d6f-bada-302e7ff8215a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:11.041927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dc12d85-f588-4d6f-bada-302e7ff8215a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:11.042362 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dc12d85-f588-4d6f-bada-302e7ff8215a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:11.043060 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dc12d85-f588-4d6f-bada-302e7ff8215a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:11.043545 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dc12d85-f588-4d6f-bada-302e7ff8215a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:11.043988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7dc12d85-f588-4d6f-bada-302e7ff8215a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:11.174514 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.objects.instance [None req-7dc12d85-f588-4d6f-bada-302e7ff8215a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lazy-loading 'services' on Instance uuid 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 {{(pid=124407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:41:11.300330 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7dc12d85-f588-4d6f-bada-302e7ff8215a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/os-volume_attachments/59897bbc-8f1d-446e-beea-0365854a0198" status: 202 len: 0 microversion: 2.1 time: 0.393883 Aug 08 13:41:11.301090 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 281/582] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:41:10 2022] DELETE /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/os-volume_attachments/59897bbc-8f1d-446e-beea-0365854a0198 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:41:13.497748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-45273ee8-390c-4688-a4bd-229d0e2d24d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:13.504215 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-45273ee8-390c-4688-a4bd-229d0e2d24d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:13.504703 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-45273ee8-390c-4688-a4bd-229d0e2d24d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:13.505139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-45273ee8-390c-4688-a4bd-229d0e2d24d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:13.528256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-45273ee8-390c-4688-a4bd-229d0e2d24d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Going to try to stop instance {{(pid=124408) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 13:41:13.579783 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-45273ee8-390c-4688-a4bd-229d0e2d24d2 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/action" status: 202 len: 0 microversion: 2.1 time: 0.086744 Aug 08 13:41:13.580448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 302/583] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:41:13 2022] POST /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:41:13.590131 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e73239fe-e4aa-4093-87e7-f7aca94f3b7a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:13.590853 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e73239fe-e4aa-4093-87e7-f7aca94f3b7a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:13.597480 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e73239fe-e4aa-4093-87e7-f7aca94f3b7a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:13.598233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e73239fe-e4aa-4093-87e7-f7aca94f3b7a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:13.598648 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e73239fe-e4aa-4093-87e7-f7aca94f3b7a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:13.599390 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e73239fe-e4aa-4093-87e7-f7aca94f3b7a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:13.599855 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e73239fe-e4aa-4093-87e7-f7aca94f3b7a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:13.600256 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e73239fe-e4aa-4093-87e7-f7aca94f3b7a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:13.738276 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e73239fe-e4aa-4093-87e7-f7aca94f3b7a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:13.746105 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e73239fe-e4aa-4093-87e7-f7aca94f3b7a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1677 microversion: 2.1 time: 0.160863 Aug 08 13:41:13.746662 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 282/584] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:13 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:41:14.769163 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-84042ea4-b5ea-4cf4-aa5e-d2e9b13472f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:14.769885 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-84042ea4-b5ea-4cf4-aa5e-d2e9b13472f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:14.779145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84042ea4-b5ea-4cf4-aa5e-d2e9b13472f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:14.779740 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84042ea4-b5ea-4cf4-aa5e-d2e9b13472f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:14.780307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84042ea4-b5ea-4cf4-aa5e-d2e9b13472f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:14.781097 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84042ea4-b5ea-4cf4-aa5e-d2e9b13472f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:14.781543 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84042ea4-b5ea-4cf4-aa5e-d2e9b13472f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:14.781954 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84042ea4-b5ea-4cf4-aa5e-d2e9b13472f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:14.921005 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-84042ea4-b5ea-4cf4-aa5e-d2e9b13472f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:14.932074 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-84042ea4-b5ea-4cf4-aa5e-d2e9b13472f6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1677 microversion: 2.1 time: 0.167658 Aug 08 13:41:14.932845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 303/585] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:14 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:15.964976 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-84d94ec2-86e4-419f-a8cc-21dbd6abfa2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:15.965770 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-84d94ec2-86e4-419f-a8cc-21dbd6abfa2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:15.972714 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84d94ec2-86e4-419f-a8cc-21dbd6abfa2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:15.973196 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84d94ec2-86e4-419f-a8cc-21dbd6abfa2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:15.973624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84d94ec2-86e4-419f-a8cc-21dbd6abfa2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:15.974316 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84d94ec2-86e4-419f-a8cc-21dbd6abfa2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:15.974767 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84d94ec2-86e4-419f-a8cc-21dbd6abfa2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:15.975214 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84d94ec2-86e4-419f-a8cc-21dbd6abfa2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:16.113227 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-84d94ec2-86e4-419f-a8cc-21dbd6abfa2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:16.120992 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-84d94ec2-86e4-419f-a8cc-21dbd6abfa2f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1677 microversion: 2.1 time: 0.162619 Aug 08 13:41:16.121597 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 283/586] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:15 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:17.143234 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2e483dfa-d97b-46ba-b432-edecb50ec213 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:17.143846 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2e483dfa-d97b-46ba-b432-edecb50ec213 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:17.151039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e483dfa-d97b-46ba-b432-edecb50ec213 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:17.151556 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e483dfa-d97b-46ba-b432-edecb50ec213 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:17.151994 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e483dfa-d97b-46ba-b432-edecb50ec213 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:17.152698 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e483dfa-d97b-46ba-b432-edecb50ec213 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:17.153140 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e483dfa-d97b-46ba-b432-edecb50ec213 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:17.153565 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e483dfa-d97b-46ba-b432-edecb50ec213 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:17.287604 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2e483dfa-d97b-46ba-b432-edecb50ec213 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:17.295433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2e483dfa-d97b-46ba-b432-edecb50ec213 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1677 microversion: 2.1 time: 0.156124 Aug 08 13:41:17.295986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 304/587] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:17 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:18.317728 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-46f12882-47ad-4865-bdc5-43dca48e7d90 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:18.318432 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-46f12882-47ad-4865-bdc5-43dca48e7d90 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:18.326187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f12882-47ad-4865-bdc5-43dca48e7d90 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:18.326728 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f12882-47ad-4865-bdc5-43dca48e7d90 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:18.327267 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f12882-47ad-4865-bdc5-43dca48e7d90 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:18.328094 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f12882-47ad-4865-bdc5-43dca48e7d90 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:18.328520 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f12882-47ad-4865-bdc5-43dca48e7d90 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:18.329001 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-46f12882-47ad-4865-bdc5-43dca48e7d90 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:18.466180 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-46f12882-47ad-4865-bdc5-43dca48e7d90 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:18.477320 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-46f12882-47ad-4865-bdc5-43dca48e7d90 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1677 microversion: 2.1 time: 0.163745 Aug 08 13:41:18.478017 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 284/588] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:18 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:19.508654 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d6de30cd-ae19-453a-844e-82d0e16a1a1d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:19.509323 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d6de30cd-ae19-453a-844e-82d0e16a1a1d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:19.516319 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d6de30cd-ae19-453a-844e-82d0e16a1a1d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:19.516796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d6de30cd-ae19-453a-844e-82d0e16a1a1d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:19.517220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d6de30cd-ae19-453a-844e-82d0e16a1a1d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:19.517937 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d6de30cd-ae19-453a-844e-82d0e16a1a1d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:19.518382 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d6de30cd-ae19-453a-844e-82d0e16a1a1d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:19.518785 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d6de30cd-ae19-453a-844e-82d0e16a1a1d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:19.667548 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d6de30cd-ae19-453a-844e-82d0e16a1a1d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:19.679541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d6de30cd-ae19-453a-844e-82d0e16a1a1d tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1677 microversion: 2.1 time: 0.175856 Aug 08 13:41:19.680199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 305/589] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:19 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:20.130535 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1a5f836d-ab37-4d11-9bf4-d0046bfd3354 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:20.131108 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1a5f836d-ab37-4d11-9bf4-d0046bfd3354 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:20.137484 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5f836d-ab37-4d11-9bf4-d0046bfd3354 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:20.137958 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5f836d-ab37-4d11-9bf4-d0046bfd3354 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:20.138380 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5f836d-ab37-4d11-9bf4-d0046bfd3354 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:20.139065 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5f836d-ab37-4d11-9bf4-d0046bfd3354 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:20.139548 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5f836d-ab37-4d11-9bf4-d0046bfd3354 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:20.139962 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5f836d-ab37-4d11-9bf4-d0046bfd3354 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:20.164837 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1a5f836d-ab37-4d11-9bf4-d0046bfd3354 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce/ips" status: 200 len: 147 microversion: 2.1 time: 0.097493 Aug 08 13:41:20.165393 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 285/590] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 13:41:20 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce/ips => generated 147 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:20.177306 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af9287f1-5814-400e-932b-572d006f38d4"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:20.179784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:20.185817 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:20.186319 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:20.186739 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:20.187459 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:20.187900 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:20.188307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:20.270289 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Invalid volume: volume af9287f1-5814-400e-932b-572d006f38d4 is already attached to instances: 11502875-0366-4e45-876a-43cbc50f7261 Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: POST /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce/os-volume_attachments HTTP/1.1 Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 74 Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:41:20.272034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {"volumeAttachment": {"volumeId": "af9287f1-5814-400e-932b-572d006f38d4"}} Aug 08 13:41:20.273642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Invalid volume: volume af9287f1-5814-400e-932b-572d006f38d4 is already attached to instances: 11502875-0366-4e45-876a-43cbc50f7261 Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'server_id': '80d56005-2c47-4e78-88a8-1e70921411ce', 'body': {'volumeAttachment': {'volumeId': 'af9287f1-5814-400e-932b-572d006f38d4'}}} Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume af9287f1-5814-400e-932b-572d006f38d4 is already attached to instances: 11502875-0366-4e45-876a-43cbc50f7261 Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:41:20.274628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume af9287f1-5814-400e-932b-572d006f38d4 is already attached to instances: 11502875-0366-4e45-876a-43cbc50f7261 Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:20.276043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:41:20.277500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:41:20.277500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:41:20.277500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:41:20.277500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume af9287f1-5814-400e-932b-572d006f38d4 is already attached to instances: 11502875-0366-4e45-876a-43cbc50f7261 Aug 08 13:41:20.277500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:41:20.277500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 400 to user: Invalid volume: volume af9287f1-5814-400e-932b-572d006f38d4 is already attached to instances: 11502875-0366-4e45-876a-43cbc50f7261 {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:41:20.277500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a8897844-48a9-4894-847a-5281515939b9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100276 Aug 08 13:41:20.277500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 306/591] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:41:20 2022] POST /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 13:41:20.282716 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-86af293e-2f11-48b8-8227-4c3c55ac308c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:20.283287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-86af293e-2f11-48b8-8227-4c3c55ac308c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:20.289772 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-86af293e-2f11-48b8-8227-4c3c55ac308c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:20.290255 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-86af293e-2f11-48b8-8227-4c3c55ac308c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:20.290707 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-86af293e-2f11-48b8-8227-4c3c55ac308c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:20.291427 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-86af293e-2f11-48b8-8227-4c3c55ac308c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:20.291920 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-86af293e-2f11-48b8-8227-4c3c55ac308c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:20.292339 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-86af293e-2f11-48b8-8227-4c3c55ac308c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:20.321905 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-86af293e-2f11-48b8-8227-4c3c55ac308c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:41:20.413361 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-86af293e-2f11-48b8-8227-4c3c55ac308c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 204 len: 0 microversion: 2.1 time: 0.134202 Aug 08 13:41:20.414062 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 286/592] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:41:20 2022] DELETE /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:41:20.422359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7125362d-5c03-478a-bb76-40dcad9d0f2a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:20.423034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7125362d-5c03-478a-bb76-40dcad9d0f2a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:20.430086 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7125362d-5c03-478a-bb76-40dcad9d0f2a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:20.430569 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7125362d-5c03-478a-bb76-40dcad9d0f2a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:20.430997 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7125362d-5c03-478a-bb76-40dcad9d0f2a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:20.431724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7125362d-5c03-478a-bb76-40dcad9d0f2a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:20.432186 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7125362d-5c03-478a-bb76-40dcad9d0f2a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:20.432609 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7125362d-5c03-478a-bb76-40dcad9d0f2a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:20.565648 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7125362d-5c03-478a-bb76-40dcad9d0f2a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:20.576793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7125362d-5c03-478a-bb76-40dcad9d0f2a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1680 microversion: 2.1 time: 0.157921 Aug 08 13:41:20.577436 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 307/593] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:20 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:41:20.702518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-59b8c96a-b8ac-4a3a-b852-abb071b93bfc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:20.703232 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-59b8c96a-b8ac-4a3a-b852-abb071b93bfc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:20.710078 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59b8c96a-b8ac-4a3a-b852-abb071b93bfc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:20.710440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59b8c96a-b8ac-4a3a-b852-abb071b93bfc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:20.710859 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59b8c96a-b8ac-4a3a-b852-abb071b93bfc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:20.711579 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59b8c96a-b8ac-4a3a-b852-abb071b93bfc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:20.712016 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59b8c96a-b8ac-4a3a-b852-abb071b93bfc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:20.712426 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-59b8c96a-b8ac-4a3a-b852-abb071b93bfc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:20.847997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-59b8c96a-b8ac-4a3a-b852-abb071b93bfc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:20.856330 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-59b8c96a-b8ac-4a3a-b852-abb071b93bfc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1677 microversion: 2.1 time: 0.158307 Aug 08 13:41:20.856867 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 287/594] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:20 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:21.607980 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-380b1dcb-074e-4036-a44e-3f669e77e198 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:21.608603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-380b1dcb-074e-4036-a44e-3f669e77e198 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:21.615609 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-380b1dcb-074e-4036-a44e-3f669e77e198 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:21.616083 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-380b1dcb-074e-4036-a44e-3f669e77e198 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:21.616506 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-380b1dcb-074e-4036-a44e-3f669e77e198 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:21.617173 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-380b1dcb-074e-4036-a44e-3f669e77e198 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:21.617618 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-380b1dcb-074e-4036-a44e-3f669e77e198 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:21.618064 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-380b1dcb-074e-4036-a44e-3f669e77e198 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:21.755555 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-380b1dcb-074e-4036-a44e-3f669e77e198 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:21.763404 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-380b1dcb-074e-4036-a44e-3f669e77e198 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1680 microversion: 2.1 time: 0.160823 Aug 08 13:41:21.763939 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 308/595] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:21 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:21.880604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e5d873cc-6799-4ea2-8cb4-2d642d1b17b3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:21.881222 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e5d873cc-6799-4ea2-8cb4-2d642d1b17b3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:21.891687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e5d873cc-6799-4ea2-8cb4-2d642d1b17b3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:21.892172 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e5d873cc-6799-4ea2-8cb4-2d642d1b17b3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:21.892767 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e5d873cc-6799-4ea2-8cb4-2d642d1b17b3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:21.893738 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e5d873cc-6799-4ea2-8cb4-2d642d1b17b3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:21.894359 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e5d873cc-6799-4ea2-8cb4-2d642d1b17b3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:21.894966 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e5d873cc-6799-4ea2-8cb4-2d642d1b17b3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:22.034035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e5d873cc-6799-4ea2-8cb4-2d642d1b17b3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:22.043778 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e5d873cc-6799-4ea2-8cb4-2d642d1b17b3 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1677 microversion: 2.1 time: 0.169000 Aug 08 13:41:22.044382 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 288/596] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:21 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:22.785068 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7ee73951-e5d6-4205-bc3a-81ca75c5be9c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:22.785998 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7ee73951-e5d6-4205-bc3a-81ca75c5be9c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:22.792727 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ee73951-e5d6-4205-bc3a-81ca75c5be9c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:22.793225 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ee73951-e5d6-4205-bc3a-81ca75c5be9c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:22.793718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ee73951-e5d6-4205-bc3a-81ca75c5be9c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:22.794468 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ee73951-e5d6-4205-bc3a-81ca75c5be9c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:22.794953 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ee73951-e5d6-4205-bc3a-81ca75c5be9c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:22.795436 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ee73951-e5d6-4205-bc3a-81ca75c5be9c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:22.932086 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7ee73951-e5d6-4205-bc3a-81ca75c5be9c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:22.939971 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7ee73951-e5d6-4205-bc3a-81ca75c5be9c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1680 microversion: 2.1 time: 0.158803 Aug 08 13:41:22.943521 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 309/597] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:22 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:23.065854 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5196d62f-3cb3-4f8e-bcf3-3bd5aaf33167 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:23.066490 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5196d62f-3cb3-4f8e-bcf3-3bd5aaf33167 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:23.073494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5196d62f-3cb3-4f8e-bcf3-3bd5aaf33167 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:23.073981 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5196d62f-3cb3-4f8e-bcf3-3bd5aaf33167 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:23.074496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5196d62f-3cb3-4f8e-bcf3-3bd5aaf33167 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:23.075291 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5196d62f-3cb3-4f8e-bcf3-3bd5aaf33167 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:23.075738 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5196d62f-3cb3-4f8e-bcf3-3bd5aaf33167 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:23.076252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5196d62f-3cb3-4f8e-bcf3-3bd5aaf33167 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:23.094999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:23.209240 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5196d62f-3cb3-4f8e-bcf3-3bd5aaf33167 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:23.217319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5196d62f-3cb3-4f8e-bcf3-3bd5aaf33167 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1677 microversion: 2.1 time: 0.155941 Aug 08 13:41:23.217917 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 289/598] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:23 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:23.597024 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-b929c83d-4ccf-4bf5-852b-4dd2b2287a70 req-7d6785d1-d50f-433c-9162-bb9314551149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d56005-2c47-4e78-88a8-1e70921411ce", "name": "network-vif-deleted", "tag": "e03791da-cff9-4890-9af8-f1729eb1a173"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:23.607772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-b929c83d-4ccf-4bf5-852b-4dd2b2287a70 req-7d6785d1-d50f-433c-9162-bb9314551149 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:23.608636 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-b929c83d-4ccf-4bf5-852b-4dd2b2287a70 req-7d6785d1-d50f-433c-9162-bb9314551149 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:23.609285 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-b929c83d-4ccf-4bf5-852b-4dd2b2287a70 req-7d6785d1-d50f-433c-9162-bb9314551149 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:23.622312 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-b929c83d-4ccf-4bf5-852b-4dd2b2287a70 req-7d6785d1-d50f-433c-9162-bb9314551149 service nova] Creating event network-vif-deleted:e03791da-cff9-4890-9af8-f1729eb1a173 for instance 80d56005-2c47-4e78-88a8-1e70921411ce on hv-cinder-85199 Aug 08 13:41:23.628087 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-b929c83d-4ccf-4bf5-852b-4dd2b2287a70 req-7d6785d1-d50f-433c-9162-bb9314551149 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097049 Aug 08 13:41:23.632858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 310/599] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:23.961612 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:23.962220 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:23.968641 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:23.969212 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:23.969611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:23.970316 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:23.970759 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:23.971202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:24.015957 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:24.016465 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:24.016981 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:24.017426 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.objects.instance [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lazy-loading 'fault' on Instance uuid 80d56005-2c47-4e78-88a8-1e70921411ce {{(pid=124407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:41:24.069874 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:24.078726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5ab0a6a6-8f3c-4559-96a1-4d863c8ed1b8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 200 len: 1332 microversion: 2.1 time: 0.120944 Aug 08 13:41:24.091452 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 290/600] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:23 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:24.240640 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-26533d36-7021-40a2-a387-d7a163f9a905 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:24.242016 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-26533d36-7021-40a2-a387-d7a163f9a905 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:24.252114 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26533d36-7021-40a2-a387-d7a163f9a905 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:24.252985 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26533d36-7021-40a2-a387-d7a163f9a905 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:24.253659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26533d36-7021-40a2-a387-d7a163f9a905 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:24.254772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26533d36-7021-40a2-a387-d7a163f9a905 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:24.255472 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26533d36-7021-40a2-a387-d7a163f9a905 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:24.256102 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-26533d36-7021-40a2-a387-d7a163f9a905 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:24.261289 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:24.685996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-26533d36-7021-40a2-a387-d7a163f9a905 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:24.695486 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-26533d36-7021-40a2-a387-d7a163f9a905 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1654 microversion: 2.1 time: 0.459805 Aug 08 13:41:24.696214 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 311/601] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:24 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1654 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:24.717067 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-985ee75e-f02f-4435-aa27-d4600c6d4b43 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:24.724156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-985ee75e-f02f-4435-aa27-d4600c6d4b43 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:24.724645 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-985ee75e-f02f-4435-aa27-d4600c6d4b43 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:24.725157 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-985ee75e-f02f-4435-aa27-d4600c6d4b43 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:24.750188 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-985ee75e-f02f-4435-aa27-d4600c6d4b43 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Going to try to start instance {{(pid=124407) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 13:41:24.797254 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-985ee75e-f02f-4435-aa27-d4600c6d4b43 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/action" status: 202 len: 0 microversion: 2.1 time: 0.083989 Aug 08 13:41:24.798216 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 291/602] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:41:24 2022] POST /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:41:24.807044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-faed0408-6a38-460e-8bd9-5ae24a4509d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:24.807776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-faed0408-6a38-460e-8bd9-5ae24a4509d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:24.814526 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-faed0408-6a38-460e-8bd9-5ae24a4509d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:24.815433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-faed0408-6a38-460e-8bd9-5ae24a4509d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:24.816258 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-faed0408-6a38-460e-8bd9-5ae24a4509d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:24.817204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-faed0408-6a38-460e-8bd9-5ae24a4509d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:24.817648 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-faed0408-6a38-460e-8bd9-5ae24a4509d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:24.818076 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-faed0408-6a38-460e-8bd9-5ae24a4509d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:24.960409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-faed0408-6a38-460e-8bd9-5ae24a4509d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:24.969676 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-faed0408-6a38-460e-8bd9-5ae24a4509d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1663 microversion: 2.1 time: 0.166383 Aug 08 13:41:24.970513 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 312/603] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:24 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:25.112972 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:25.113689 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:25.120445 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:25.121325 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:25.121754 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:25.122447 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:25.122892 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:25.123335 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:25.139755 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce HTTP/1.1 Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:41:25.144444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:41:25.145891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '80d56005-2c47-4e78-88a8-1e70921411ce'} Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:41:25.146725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:41:25.148236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:41:25.149647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:41:25.149647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ce345656-fa4c-44a0-bc98-029e1909282b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 404 len: 111 microversion: 2.1 time: 0.037243 Aug 08 13:41:25.149647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 292/604] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:25 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:41:25.157496 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e6043300-6cd2-4715-a57a-f1bde6f86587 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '.version_select at 0x7f7d242bcee0>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:25.181909 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e6043300-6cd2-4715-a57a-f1bde6f86587 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678759163" status: 202 len: 0 microversion: 2.1 time: 0.028335 Aug 08 13:41:25.182486 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 313/605] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Aug 8 13:41:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678759163 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:41:25.992457 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-47d543a6-4195-45e1-9151-66efc5f37aa1 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:25.993055 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-47d543a6-4195-45e1-9151-66efc5f37aa1 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:25.999657 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d543a6-4195-45e1-9151-66efc5f37aa1 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:26.000148 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d543a6-4195-45e1-9151-66efc5f37aa1 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:26.000602 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d543a6-4195-45e1-9151-66efc5f37aa1 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:26.001330 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d543a6-4195-45e1-9151-66efc5f37aa1 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:26.001820 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d543a6-4195-45e1-9151-66efc5f37aa1 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:26.002231 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47d543a6-4195-45e1-9151-66efc5f37aa1 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:26.145552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-47d543a6-4195-45e1-9151-66efc5f37aa1 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:26.157491 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-47d543a6-4195-45e1-9151-66efc5f37aa1 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1663 microversion: 2.1 time: 0.168836 Aug 08 13:41:26.167174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 293/606] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:25 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:26.258775 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d359debd-3ef4-42ca-b7c2-0340a7cd416f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:26.259494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d359debd-3ef4-42ca-b7c2-0340a7cd416f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:26.261429 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:26.268841 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d359debd-3ef4-42ca-b7c2-0340a7cd416f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:26.269335 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d359debd-3ef4-42ca-b7c2-0340a7cd416f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:26.269766 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d359debd-3ef4-42ca-b7c2-0340a7cd416f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:26.270465 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d359debd-3ef4-42ca-b7c2-0340a7cd416f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:26.270913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d359debd-3ef4-42ca-b7c2-0340a7cd416f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:26.271373 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d359debd-3ef4-42ca-b7c2-0340a7cd416f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:26.354665 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-d359debd-3ef4-42ca-b7c2-0340a7cd416f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lazy-loading 'services' on Instance uuid 11502875-0366-4e45-876a-43cbc50f7261 {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:41:26.468330 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d359debd-3ef4-42ca-b7c2-0340a7cd416f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-volume_attachments/af9287f1-5814-400e-932b-572d006f38d4" status: 202 len: 0 microversion: 2.1 time: 0.214054 Aug 08 13:41:26.468916 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 314/607] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:41:26 2022] DELETE /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-volume_attachments/af9287f1-5814-400e-932b-572d006f38d4 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:41:26.477610 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-227bc301-5734-4be4-8800-a72a64f18763 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:26.480415 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-227bc301-5734-4be4-8800-a72a64f18763 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:26.486441 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-227bc301-5734-4be4-8800-a72a64f18763 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:26.486919 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-227bc301-5734-4be4-8800-a72a64f18763 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:26.487374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-227bc301-5734-4be4-8800-a72a64f18763 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:26.488064 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-227bc301-5734-4be4-8800-a72a64f18763 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:26.488509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-227bc301-5734-4be4-8800-a72a64f18763 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:26.488926 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-227bc301-5734-4be4-8800-a72a64f18763 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:26.518675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-227bc301-5734-4be4-8800-a72a64f18763 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045111 Aug 08 13:41:26.519269 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 294/608] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:41:26 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:27.197025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d41a375b-1aa9-4784-a136-b5ed11562a79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:27.197742 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d41a375b-1aa9-4784-a136-b5ed11562a79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:27.204639 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d41a375b-1aa9-4784-a136-b5ed11562a79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:27.205120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d41a375b-1aa9-4784-a136-b5ed11562a79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:27.205553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d41a375b-1aa9-4784-a136-b5ed11562a79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:27.206243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d41a375b-1aa9-4784-a136-b5ed11562a79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:27.206693 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d41a375b-1aa9-4784-a136-b5ed11562a79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:27.207124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d41a375b-1aa9-4784-a136-b5ed11562a79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:27.351781 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d41a375b-1aa9-4784-a136-b5ed11562a79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:27.359880 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d41a375b-1aa9-4784-a136-b5ed11562a79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1667 microversion: 2.1 time: 0.167107 Aug 08 13:41:27.360426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 315/609] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:27 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1667 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:27.531951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9620ac38-f635-4ad2-aa42-f36c5bfc0f92 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:27.534126 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9620ac38-f635-4ad2-aa42-f36c5bfc0f92 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:27.540995 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9620ac38-f635-4ad2-aa42-f36c5bfc0f92 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:27.541469 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9620ac38-f635-4ad2-aa42-f36c5bfc0f92 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:27.541951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9620ac38-f635-4ad2-aa42-f36c5bfc0f92 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:27.542824 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9620ac38-f635-4ad2-aa42-f36c5bfc0f92 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:27.543325 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9620ac38-f635-4ad2-aa42-f36c5bfc0f92 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:27.543755 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9620ac38-f635-4ad2-aa42-f36c5bfc0f92 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:27.573836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9620ac38-f635-4ad2-aa42-f36c5bfc0f92 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Aug 08 13:41:27.574551 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 295/610] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:41:27 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:28.586792 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-48f05c80-0661-4af1-966e-265a0746a382 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:28.589120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-48f05c80-0661-4af1-966e-265a0746a382 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:28.596630 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-48f05c80-0661-4af1-966e-265a0746a382 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:28.597385 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-48f05c80-0661-4af1-966e-265a0746a382 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:28.597923 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-48f05c80-0661-4af1-966e-265a0746a382 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:28.598762 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-48f05c80-0661-4af1-966e-265a0746a382 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:28.599351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-48f05c80-0661-4af1-966e-265a0746a382 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:28.599864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-48f05c80-0661-4af1-966e-265a0746a382 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:28.633745 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-48f05c80-0661-4af1-966e-265a0746a382 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051026 Aug 08 13:41:28.634291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 316/611] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:41:28 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 13:41:28.697609 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fb633c4d-237c-4ce0-90aa-aded4f95c50e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:28.698182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-fb633c4d-237c-4ce0-90aa-aded4f95c50e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:28.706332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb633c4d-237c-4ce0-90aa-aded4f95c50e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:28.706817 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb633c4d-237c-4ce0-90aa-aded4f95c50e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:28.707284 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb633c4d-237c-4ce0-90aa-aded4f95c50e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:28.707986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb633c4d-237c-4ce0-90aa-aded4f95c50e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:28.708433 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb633c4d-237c-4ce0-90aa-aded4f95c50e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:28.708850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb633c4d-237c-4ce0-90aa-aded4f95c50e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:28.735771 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-fb633c4d-237c-4ce0-90aa-aded4f95c50e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:41:28.824597 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-fb633c4d-237c-4ce0-90aa-aded4f95c50e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 204 len: 0 microversion: 2.1 time: 0.129781 Aug 08 13:41:28.825526 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 296/612] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:41:28 2022] DELETE /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:41:28.836754 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a5b5b122-8099-48ba-876d-ec1bb8147eb5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:28.837352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a5b5b122-8099-48ba-876d-ec1bb8147eb5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:28.843509 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5b5b122-8099-48ba-876d-ec1bb8147eb5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:28.844003 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5b5b122-8099-48ba-876d-ec1bb8147eb5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:28.844425 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5b5b122-8099-48ba-876d-ec1bb8147eb5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:28.845109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5b5b122-8099-48ba-876d-ec1bb8147eb5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:28.845549 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5b5b122-8099-48ba-876d-ec1bb8147eb5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:28.845964 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5b5b122-8099-48ba-876d-ec1bb8147eb5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:28.980553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a5b5b122-8099-48ba-876d-ec1bb8147eb5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:28.988414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a5b5b122-8099-48ba-876d-ec1bb8147eb5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1679 microversion: 2.1 time: 0.155684 Aug 08 13:41:28.988971 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 317/613] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:28 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:30.012390 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-40543138-64f8-4036-8282-f41743da190c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:30.013087 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-40543138-64f8-4036-8282-f41743da190c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:30.020294 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-40543138-64f8-4036-8282-f41743da190c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:30.020785 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-40543138-64f8-4036-8282-f41743da190c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:30.021211 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-40543138-64f8-4036-8282-f41743da190c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:30.021910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-40543138-64f8-4036-8282-f41743da190c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:30.022356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-40543138-64f8-4036-8282-f41743da190c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:30.022770 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-40543138-64f8-4036-8282-f41743da190c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:30.164385 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-40543138-64f8-4036-8282-f41743da190c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:30.172478 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-40543138-64f8-4036-8282-f41743da190c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1679 microversion: 2.1 time: 0.165671 Aug 08 13:41:30.173032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 297/614] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:30 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:31.196329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d4a14c19-35e7-486d-95c4-ba9df6351913 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:31.197006 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d4a14c19-35e7-486d-95c4-ba9df6351913 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:31.214118 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4a14c19-35e7-486d-95c4-ba9df6351913 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:31.214645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4a14c19-35e7-486d-95c4-ba9df6351913 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:31.215110 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4a14c19-35e7-486d-95c4-ba9df6351913 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:31.215807 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4a14c19-35e7-486d-95c4-ba9df6351913 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:31.216292 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4a14c19-35e7-486d-95c4-ba9df6351913 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:31.216747 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4a14c19-35e7-486d-95c4-ba9df6351913 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:31.356175 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d4a14c19-35e7-486d-95c4-ba9df6351913 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:31.364437 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d4a14c19-35e7-486d-95c4-ba9df6351913 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1679 microversion: 2.1 time: 0.172880 Aug 08 13:41:31.365017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 318/615] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:31 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:31.941496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-c12c28e6-9257-46a4-ae7f-fbe32e69af89 req-8f57114d-b876-4817-bb8d-65008d2edf01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11502875-0366-4e45-876a-43cbc50f7261", "name": "network-vif-deleted", "tag": "01423313-09fc-4ac2-a4ed-f147bfe4ee5c"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:31.953438 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-c12c28e6-9257-46a4-ae7f-fbe32e69af89 req-8f57114d-b876-4817-bb8d-65008d2edf01 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:31.953920 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-c12c28e6-9257-46a4-ae7f-fbe32e69af89 req-8f57114d-b876-4817-bb8d-65008d2edf01 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:31.954334 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-c12c28e6-9257-46a4-ae7f-fbe32e69af89 req-8f57114d-b876-4817-bb8d-65008d2edf01 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:31.974326 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-c12c28e6-9257-46a4-ae7f-fbe32e69af89 req-8f57114d-b876-4817-bb8d-65008d2edf01 service nova] Creating event network-vif-deleted:01423313-09fc-4ac2-a4ed-f147bfe4ee5c for instance 11502875-0366-4e45-876a-43cbc50f7261 on hv-cinder-85199 Aug 08 13:41:31.985360 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-c12c28e6-9257-46a4-ae7f-fbe32e69af89 req-8f57114d-b876-4817-bb8d-65008d2edf01 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048737 Aug 08 13:41:31.986533 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 298/616] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:32.389323 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:32.390469 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:32.398590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:32.399401 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:32.399838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:32.400543 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:32.400991 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:32.401423 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:32.435715 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:32.436581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:32.437362 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:32.438041 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lazy-loading 'fault' on Instance uuid 11502875-0366-4e45-876a-43cbc50f7261 {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:41:32.503239 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:32.511956 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-458f18fb-5308-42ad-a2c6-ae5ad91d1d53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 200 len: 1331 microversion: 2.1 time: 0.126628 Aug 08 13:41:32.513228 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 319/617] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:32 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:33.538482 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:33.539235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:33.542653 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:33.549244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:33.549866 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:33.550507 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:33.551550 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:33.552181 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:33.552713 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:33.571980 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 HTTP/1.1 Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:41:33.573640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:41:33.575386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '11502875-0366-4e45-876a-43cbc50f7261'} Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:41:33.576281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:41:33.577768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:41:33.579150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:41:33.579150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2419375d-5233-4cec-a467-3d2b39099e0e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 404 len: 111 microversion: 2.1 time: 0.041034 Aug 08 13:41:33.579150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 299/618] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:33 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:41:33.584616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4c36669a-f052-4960-8b2b-7bc4f9223ec8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '.version_select at 0x7f7d2421c940>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:33.609159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4c36669a-f052-4960-8b2b-7bc4f9223ec8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-967042771" status: 202 len: 0 microversion: 2.1 time: 0.028534 Aug 08 13:41:33.609748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 320/619] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Aug 8 13:41:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-967042771 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:41:34.301123 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6c2f195c-fcde-419a-a04f-2efae0a5b12b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: .version_select at 0x7f7d241c8820>, body: {"keypair": {"name": "tempest-keypair-1513619601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTEgZogxwwJWP1uJG21S6u20cvE/9k8TGUBIJ5iANlZwQjoPc9X7AdXgdz4fXt0gzpWlvK8tfOCN2FQAM2bvMVbdjjqmTlrrP+6o+RqyZmb9j1+eEm9mm1QGITl6IGshw=="}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:34.316534 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-6c2f195c-fcde-419a-a04f-2efae0a5b12b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:41:34.320322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-6c2f195c-fcde-419a-a04f-2efae0a5b12b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for user fce6a7d7dbc94adeb0b03bae34e335a0 and project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:41:34.349467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6c2f195c-fcde-419a-a04f-2efae0a5b12b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052034 Aug 08 13:41:34.350083 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 300/620] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 13:41:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:35.715652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-553855852", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96099fae-9cab-447b-98a0-f55f4a95af9e"}], "security_groups": [{"name": "tempest-securitygroup--786633356"}], "key_name": "tempest-keypair-1513619601", "user_data": "}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:35.821774 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] validate_networks() for [('96099fae-9cab-447b-98a0-f55f4a95af9e', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:41:36.265000 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:41:36.265617 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:41:36.266509 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:41:36.267200 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:41:36.267821 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:41:36.278173 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:36.278652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:36.279105 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:36.279823 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:36.280291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:36.280684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:36.298630 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:41:36.302894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for user fce6a7d7dbc94adeb0b03bae34e335a0 and project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:41:36.315724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:41:36.318028 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:41:36.371602 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-21e398da-e04d-49ed-a2d1-023927b3b815 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.660875 Aug 08 13:41:36.378462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 321/621] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:41:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:41:36.392695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-17cec663-af00-48b5-a3a6-81fd58f52212 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:36.394804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-17cec663-af00-48b5-a3a6-81fd58f52212 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:36.452551 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-17cec663-af00-48b5-a3a6-81fd58f52212 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:36.459691 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-17cec663-af00-48b5-a3a6-81fd58f52212 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1241 microversion: 2.1 time: 0.073535 Aug 08 13:41:36.460245 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 301/622] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:36 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:37.481638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-814da1a3-a04f-418b-acbe-b227bd3ed479 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:37.482390 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-814da1a3-a04f-418b-acbe-b227bd3ed479 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:37.489500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-814da1a3-a04f-418b-acbe-b227bd3ed479 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:37.489996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-814da1a3-a04f-418b-acbe-b227bd3ed479 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:37.490668 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-814da1a3-a04f-418b-acbe-b227bd3ed479 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:37.491485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-814da1a3-a04f-418b-acbe-b227bd3ed479 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:37.491940 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-814da1a3-a04f-418b-acbe-b227bd3ed479 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:37.492366 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-814da1a3-a04f-418b-acbe-b227bd3ed479 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:37.573623 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-814da1a3-a04f-418b-acbe-b227bd3ed479 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:37.582422 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-814da1a3-a04f-418b-acbe-b227bd3ed479 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1293 microversion: 2.1 time: 0.105968 Aug 08 13:41:37.583017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 322/623] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:37 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:38.606222 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6e3098dc-96d1-4281-ba76-6cec9dde477d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:38.607792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6e3098dc-96d1-4281-ba76-6cec9dde477d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:38.615468 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e3098dc-96d1-4281-ba76-6cec9dde477d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:38.616380 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e3098dc-96d1-4281-ba76-6cec9dde477d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:38.616943 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e3098dc-96d1-4281-ba76-6cec9dde477d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:38.617911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e3098dc-96d1-4281-ba76-6cec9dde477d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:38.618499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e3098dc-96d1-4281-ba76-6cec9dde477d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:38.618822 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e3098dc-96d1-4281-ba76-6cec9dde477d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:38.790047 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6e3098dc-96d1-4281-ba76-6cec9dde477d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:38.798152 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6e3098dc-96d1-4281-ba76-6cec9dde477d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1366 microversion: 2.1 time: 0.196610 Aug 08 13:41:38.798740 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 302/624] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:38 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:41:39.280925 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-75b79815-1073-405c-b634-3bc1f909550c req-40fdc9ff-21fc-403d-aa25-a0a1470475e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e355ee-03af-44f5-b661-405530019c73", "tag": "2f0f1b91-5027-4893-908c-797a761e4624"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:39.292731 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-75b79815-1073-405c-b634-3bc1f909550c req-40fdc9ff-21fc-403d-aa25-a0a1470475e2 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:39.293186 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-75b79815-1073-405c-b634-3bc1f909550c req-40fdc9ff-21fc-403d-aa25-a0a1470475e2 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:39.293624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-75b79815-1073-405c-b634-3bc1f909550c req-40fdc9ff-21fc-403d-aa25-a0a1470475e2 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:39.305962 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-75b79815-1073-405c-b634-3bc1f909550c req-40fdc9ff-21fc-403d-aa25-a0a1470475e2 service nova] Creating event network-changed:2f0f1b91-5027-4893-908c-797a761e4624 for instance 16e355ee-03af-44f5-b661-405530019c73 on hv-cinder-85199 Aug 08 13:41:39.311424 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-75b79815-1073-405c-b634-3bc1f909550c req-40fdc9ff-21fc-403d-aa25-a0a1470475e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034649 Aug 08 13:41:39.312205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 323/625] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:39.820959 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4e78ef95-6285-42c5-b9fd-7dea62e4f149 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:39.821573 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4e78ef95-6285-42c5-b9fd-7dea62e4f149 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:39.828526 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e78ef95-6285-42c5-b9fd-7dea62e4f149 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:39.829012 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e78ef95-6285-42c5-b9fd-7dea62e4f149 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:39.829440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e78ef95-6285-42c5-b9fd-7dea62e4f149 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:39.830149 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e78ef95-6285-42c5-b9fd-7dea62e4f149 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:39.830579 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e78ef95-6285-42c5-b9fd-7dea62e4f149 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:39.831003 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e78ef95-6285-42c5-b9fd-7dea62e4f149 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:39.977085 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4e78ef95-6285-42c5-b9fd-7dea62e4f149 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:39.986690 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4e78ef95-6285-42c5-b9fd-7dea62e4f149 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1366 microversion: 2.1 time: 0.169872 Aug 08 13:41:39.987381 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 303/626] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:39 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:41.011979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d58f674e-15bb-4a08-8b9c-55a6a26c193b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:41.012706 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d58f674e-15bb-4a08-8b9c-55a6a26c193b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:41.019654 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d58f674e-15bb-4a08-8b9c-55a6a26c193b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:41.020050 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d58f674e-15bb-4a08-8b9c-55a6a26c193b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:41.020563 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d58f674e-15bb-4a08-8b9c-55a6a26c193b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:41.021354 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d58f674e-15bb-4a08-8b9c-55a6a26c193b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:41.021860 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d58f674e-15bb-4a08-8b9c-55a6a26c193b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:41.022314 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d58f674e-15bb-4a08-8b9c-55a6a26c193b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:41.161882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d58f674e-15bb-4a08-8b9c-55a6a26c193b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:41.170048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d58f674e-15bb-4a08-8b9c-55a6a26c193b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1366 microversion: 2.1 time: 0.163827 Aug 08 13:41:41.170620 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 324/627] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:41 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:42.191422 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c4f78c88-c044-4023-b37c-2935c1bc166d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:42.191999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c4f78c88-c044-4023-b37c-2935c1bc166d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:42.198648 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4f78c88-c044-4023-b37c-2935c1bc166d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:42.199121 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4f78c88-c044-4023-b37c-2935c1bc166d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:42.199571 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4f78c88-c044-4023-b37c-2935c1bc166d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:42.200532 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4f78c88-c044-4023-b37c-2935c1bc166d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:42.200976 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4f78c88-c044-4023-b37c-2935c1bc166d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:42.201384 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4f78c88-c044-4023-b37c-2935c1bc166d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:42.350816 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c4f78c88-c044-4023-b37c-2935c1bc166d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:42.359456 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c4f78c88-c044-4023-b37c-2935c1bc166d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1366 microversion: 2.1 time: 0.171822 Aug 08 13:41:42.360107 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 304/628] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:42 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:43.381692 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-23bc4ac1-b798-4554-9d9d-a4bd9b4138fe tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:43.382269 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-23bc4ac1-b798-4554-9d9d-a4bd9b4138fe tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:43.389995 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-23bc4ac1-b798-4554-9d9d-a4bd9b4138fe tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:43.390482 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-23bc4ac1-b798-4554-9d9d-a4bd9b4138fe tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:43.390907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-23bc4ac1-b798-4554-9d9d-a4bd9b4138fe tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:43.391640 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-23bc4ac1-b798-4554-9d9d-a4bd9b4138fe tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:43.392084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-23bc4ac1-b798-4554-9d9d-a4bd9b4138fe tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:43.392496 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-23bc4ac1-b798-4554-9d9d-a4bd9b4138fe tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:43.539244 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-23bc4ac1-b798-4554-9d9d-a4bd9b4138fe tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:43.546834 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-23bc4ac1-b798-4554-9d9d-a4bd9b4138fe tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1366 microversion: 2.1 time: 0.169754 Aug 08 13:41:43.547436 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 325/629] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:43 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:44.570127 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d0b7879c-81b5-47c3-9364-e65e7fea7221 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:44.570861 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d0b7879c-81b5-47c3-9364-e65e7fea7221 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:44.578312 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d0b7879c-81b5-47c3-9364-e65e7fea7221 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:44.578793 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d0b7879c-81b5-47c3-9364-e65e7fea7221 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:44.579267 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d0b7879c-81b5-47c3-9364-e65e7fea7221 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:44.579973 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d0b7879c-81b5-47c3-9364-e65e7fea7221 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:44.580409 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d0b7879c-81b5-47c3-9364-e65e7fea7221 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:44.580848 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d0b7879c-81b5-47c3-9364-e65e7fea7221 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:44.725102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d0b7879c-81b5-47c3-9364-e65e7fea7221 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:44.734850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d0b7879c-81b5-47c3-9364-e65e7fea7221 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1366 microversion: 2.1 time: 0.170427 Aug 08 13:41:44.735485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 305/630] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:44 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:45.755897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8c293d6e-f7bd-4730-b57b-0798c6495f2e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:45.756686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8c293d6e-f7bd-4730-b57b-0798c6495f2e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:45.763485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c293d6e-f7bd-4730-b57b-0798c6495f2e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:45.763960 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c293d6e-f7bd-4730-b57b-0798c6495f2e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:45.764385 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c293d6e-f7bd-4730-b57b-0798c6495f2e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:45.765052 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c293d6e-f7bd-4730-b57b-0798c6495f2e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:45.765490 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c293d6e-f7bd-4730-b57b-0798c6495f2e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:45.765904 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8c293d6e-f7bd-4730-b57b-0798c6495f2e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:45.905183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8c293d6e-f7bd-4730-b57b-0798c6495f2e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:45.916566 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8c293d6e-f7bd-4730-b57b-0798c6495f2e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1366 microversion: 2.1 time: 0.164401 Aug 08 13:41:45.917561 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 326/631] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:45 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:46.928709 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:46.938558 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7b5a4bc6-71f0-4207-ab0d-332f97ce3083 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:46.939198 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7b5a4bc6-71f0-4207-ab0d-332f97ce3083 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:46.945535 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:46.946218 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:46.948333 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b5a4bc6-71f0-4207-ab0d-332f97ce3083 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:46.948986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b5a4bc6-71f0-4207-ab0d-332f97ce3083 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:46.949695 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b5a4bc6-71f0-4207-ab0d-332f97ce3083 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:46.950792 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b5a4bc6-71f0-4207-ab0d-332f97ce3083 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:46.951461 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b5a4bc6-71f0-4207-ab0d-332f97ce3083 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:46.952059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7b5a4bc6-71f0-4207-ab0d-332f97ce3083 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:46.991549 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-f5a4e0d4-803b-4be2-a6af-eba7d523b703 req-2bb248ba-0e07-450b-860c-3fcc8e74451a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e355ee-03af-44f5-b661-405530019c73", "name": "network-vif-plugged", "status": "completed", "tag": "2f0f1b91-5027-4893-908c-797a761e4624"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:47.001513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-f5a4e0d4-803b-4be2-a6af-eba7d523b703 req-2bb248ba-0e07-450b-860c-3fcc8e74451a service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:47.001992 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-f5a4e0d4-803b-4be2-a6af-eba7d523b703 req-2bb248ba-0e07-450b-860c-3fcc8e74451a service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:47.002414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-f5a4e0d4-803b-4be2-a6af-eba7d523b703 req-2bb248ba-0e07-450b-860c-3fcc8e74451a service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:47.014450 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-f5a4e0d4-803b-4be2-a6af-eba7d523b703 req-2bb248ba-0e07-450b-860c-3fcc8e74451a service nova] Creating event network-vif-plugged:2f0f1b91-5027-4893-908c-797a761e4624 for instance 16e355ee-03af-44f5-b661-405530019c73 on hv-cinder-85199 Aug 08 13:41:47.019574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-f5a4e0d4-803b-4be2-a6af-eba7d523b703 req-2bb248ba-0e07-450b-860c-3fcc8e74451a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095691 Aug 08 13:41:47.020314 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 306/632] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:47.101691 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7b5a4bc6-71f0-4207-ab0d-332f97ce3083 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:47.110298 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7b5a4bc6-71f0-4207-ab0d-332f97ce3083 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1366 microversion: 2.1 time: 0.175554 Aug 08 13:41:47.110889 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 327/633] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:46 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:48.132464 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f5d01dd4-e373-4b8b-952f-6fc71163406a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:48.133156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f5d01dd4-e373-4b8b-952f-6fc71163406a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:48.139718 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5d01dd4-e373-4b8b-952f-6fc71163406a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:48.140207 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5d01dd4-e373-4b8b-952f-6fc71163406a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:48.140634 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5d01dd4-e373-4b8b-952f-6fc71163406a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:48.141334 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5d01dd4-e373-4b8b-952f-6fc71163406a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:48.141840 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5d01dd4-e373-4b8b-952f-6fc71163406a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:48.142262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f5d01dd4-e373-4b8b-952f-6fc71163406a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:48.280326 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f5d01dd4-e373-4b8b-952f-6fc71163406a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:48.284012 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:48.288840 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f5d01dd4-e373-4b8b-952f-6fc71163406a tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1366 microversion: 2.1 time: 0.160993 Aug 08 13:41:48.289417 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 307/634] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:48 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:49.311705 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a2a82885-e96d-4875-a07b-5e2c6587f56f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:49.312442 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a2a82885-e96d-4875-a07b-5e2c6587f56f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:49.321178 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2a82885-e96d-4875-a07b-5e2c6587f56f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:49.321791 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2a82885-e96d-4875-a07b-5e2c6587f56f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:49.322354 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2a82885-e96d-4875-a07b-5e2c6587f56f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:49.323230 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2a82885-e96d-4875-a07b-5e2c6587f56f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:49.323770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2a82885-e96d-4875-a07b-5e2c6587f56f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:49.324338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a2a82885-e96d-4875-a07b-5e2c6587f56f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:49.461548 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a2a82885-e96d-4875-a07b-5e2c6587f56f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:49.469322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a2a82885-e96d-4875-a07b-5e2c6587f56f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1555 microversion: 2.1 time: 0.162595 Aug 08 13:41:49.469898 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 328/635] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:41:49 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:49.491767 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-456731e8-b4f3-425f-b00d-1eead341fc0c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:49.492438 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-456731e8-b4f3-425f-b00d-1eead341fc0c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:49.499407 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-456731e8-b4f3-425f-b00d-1eead341fc0c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:49.499884 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-456731e8-b4f3-425f-b00d-1eead341fc0c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:49.500316 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-456731e8-b4f3-425f-b00d-1eead341fc0c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:49.501000 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-456731e8-b4f3-425f-b00d-1eead341fc0c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:49.501440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-456731e8-b4f3-425f-b00d-1eead341fc0c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:49.501851 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-456731e8-b4f3-425f-b00d-1eead341fc0c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:49.588315 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-456731e8-b4f3-425f-b00d-1eead341fc0c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100951 Aug 08 13:41:49.588918 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 308/636] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 13:41:49 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:50.583606 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-80c31bf0-edfe-4948-90ae-c93c112ecdf3 req-06b88f34-7a3d-44f4-aa49-02092fb0e6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e355ee-03af-44f5-b661-405530019c73", "tag": "2f0f1b91-5027-4893-908c-797a761e4624"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:50.597138 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-80c31bf0-edfe-4948-90ae-c93c112ecdf3 req-06b88f34-7a3d-44f4-aa49-02092fb0e6ad service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:50.597881 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-80c31bf0-edfe-4948-90ae-c93c112ecdf3 req-06b88f34-7a3d-44f4-aa49-02092fb0e6ad service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:50.598563 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-80c31bf0-edfe-4948-90ae-c93c112ecdf3 req-06b88f34-7a3d-44f4-aa49-02092fb0e6ad service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:50.612102 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-80c31bf0-edfe-4948-90ae-c93c112ecdf3 req-06b88f34-7a3d-44f4-aa49-02092fb0e6ad service nova] Creating event network-changed:2f0f1b91-5027-4893-908c-797a761e4624 for instance 16e355ee-03af-44f5-b661-405530019c73 on hv-cinder-85199 Aug 08 13:41:50.617790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-80c31bf0-edfe-4948-90ae-c93c112ecdf3 req-06b88f34-7a3d-44f4-aa49-02092fb0e6ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038104 Aug 08 13:41:50.618629 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 329/637] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:41:53.893233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-825a05b1-9ff8-4400-9eb2-37c54ebcb1ad tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:53.893775 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-825a05b1-9ff8-4400-9eb2-37c54ebcb1ad tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:53.900067 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-825a05b1-9ff8-4400-9eb2-37c54ebcb1ad tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:53.900553 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-825a05b1-9ff8-4400-9eb2-37c54ebcb1ad tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:53.900983 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-825a05b1-9ff8-4400-9eb2-37c54ebcb1ad tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:53.901666 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-825a05b1-9ff8-4400-9eb2-37c54ebcb1ad tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:53.902105 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-825a05b1-9ff8-4400-9eb2-37c54ebcb1ad tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:53.902521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-825a05b1-9ff8-4400-9eb2-37c54ebcb1ad tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:53.930731 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-825a05b1-9ff8-4400-9eb2-37c54ebcb1ad tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments/1faec280-b6d0-42c0-86f8-fb45b9a4d480" status: 200 len: 194 microversion: 2.20 time: 0.154297 Aug 08 13:41:53.931533 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 309/638] 10.222.0.33 () {60 vars in 1454 bytes} [Mon Aug 8 13:41:53 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments/1faec280-b6d0-42c0-86f8-fb45b9a4d480 => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:41:54.001234 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4b1f4aba-e2bc-4879-8b6b-ee3fb3ef3bf0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:54.001924 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4b1f4aba-e2bc-4879-8b6b-ee3fb3ef3bf0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:54.008938 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b1f4aba-e2bc-4879-8b6b-ee3fb3ef3bf0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:54.009411 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b1f4aba-e2bc-4879-8b6b-ee3fb3ef3bf0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:54.009835 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b1f4aba-e2bc-4879-8b6b-ee3fb3ef3bf0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:54.010514 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b1f4aba-e2bc-4879-8b6b-ee3fb3ef3bf0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:54.010953 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b1f4aba-e2bc-4879-8b6b-ee3fb3ef3bf0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:54.011398 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4b1f4aba-e2bc-4879-8b6b-ee3fb3ef3bf0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:54.100894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:54.105351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-4b1f4aba-e2bc-4879-8b6b-ee3fb3ef3bf0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lazy-loading 'services' on Instance uuid b337a957-cd21-4f51-aa36-f64ad24aee7c {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:41:54.184049 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4b1f4aba-e2bc-4879-8b6b-ee3fb3ef3bf0 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments/1faec280-b6d0-42c0-86f8-fb45b9a4d480" status: 202 len: 0 microversion: 2.20 time: 0.187767 Aug 08 13:41:54.184526 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 330/639] 10.222.0.33 () {60 vars in 1457 bytes} [Mon Aug 8 13:41:53 2022] DELETE /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments/1faec280-b6d0-42c0-86f8-fb45b9a4d480 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:41:54.193609 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d8443bdf-829c-4c95-8f42-2808120ea1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:54.195898 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d8443bdf-829c-4c95-8f42-2808120ea1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:54.202187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8443bdf-829c-4c95-8f42-2808120ea1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:54.202704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8443bdf-829c-4c95-8f42-2808120ea1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:54.203217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8443bdf-829c-4c95-8f42-2808120ea1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:54.203970 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8443bdf-829c-4c95-8f42-2808120ea1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:54.204542 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8443bdf-829c-4c95-8f42-2808120ea1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:54.204965 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8443bdf-829c-4c95-8f42-2808120ea1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:54.239595 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d8443bdf-829c-4c95-8f42-2808120ea1fd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049993 Aug 08 13:41:54.242270 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 310/640] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Aug 8 13:41:54 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:41:55.255436 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-cc24dd12-feb5-45fd-91ea-cfc3ae08ed1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:55.257840 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-cc24dd12-feb5-45fd-91ea-cfc3ae08ed1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:55.265084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cc24dd12-feb5-45fd-91ea-cfc3ae08ed1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:55.265569 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cc24dd12-feb5-45fd-91ea-cfc3ae08ed1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:55.265995 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cc24dd12-feb5-45fd-91ea-cfc3ae08ed1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:55.266706 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cc24dd12-feb5-45fd-91ea-cfc3ae08ed1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:55.267182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cc24dd12-feb5-45fd-91ea-cfc3ae08ed1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:55.267600 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cc24dd12-feb5-45fd-91ea-cfc3ae08ed1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:55.300811 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-cc24dd12-feb5-45fd-91ea-cfc3ae08ed1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050262 Aug 08 13:41:55.301368 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 331/641] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Aug 8 13:41:55 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:41:56.314396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-81ebb419-5bad-44ae-bbf9-af68df078d9c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:56.316562 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-81ebb419-5bad-44ae-bbf9-af68df078d9c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:56.323453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81ebb419-5bad-44ae-bbf9-af68df078d9c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:56.323930 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81ebb419-5bad-44ae-bbf9-af68df078d9c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:56.324359 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81ebb419-5bad-44ae-bbf9-af68df078d9c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:56.325050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81ebb419-5bad-44ae-bbf9-af68df078d9c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:56.325493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81ebb419-5bad-44ae-bbf9-af68df078d9c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:56.325901 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-81ebb419-5bad-44ae-bbf9-af68df078d9c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:56.355658 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-81ebb419-5bad-44ae-bbf9-af68df078d9c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045424 Aug 08 13:41:56.356136 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 311/642] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Aug 8 13:41:56 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:41:56.419168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-503233ee-ca76-4415-ab4a-1a6b43da2217 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:56.419773 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-503233ee-ca76-4415-ab4a-1a6b43da2217 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:56.422222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:41:56.428480 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503233ee-ca76-4415-ab4a-1a6b43da2217 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:56.428954 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503233ee-ca76-4415-ab4a-1a6b43da2217 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:56.429413 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503233ee-ca76-4415-ab4a-1a6b43da2217 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:56.430128 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503233ee-ca76-4415-ab4a-1a6b43da2217 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:56.430571 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503233ee-ca76-4415-ab4a-1a6b43da2217 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:56.431031 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-503233ee-ca76-4415-ab4a-1a6b43da2217 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:56.456981 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-503233ee-ca76-4415-ab4a-1a6b43da2217 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Going to try to terminate instance {{(pid=124408) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:41:56.545736 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-503233ee-ca76-4415-ab4a-1a6b43da2217 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 204 len: 0 microversion: 2.20 time: 0.130193 Aug 08 13:41:56.546359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 332/643] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Aug 8 13:41:56 2022] DELETE /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 13:41:56.554874 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:56.555495 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:56.561597 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:56.562063 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:56.562480 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:56.563206 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:56.563682 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:56.564088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:56.699784 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:56.708630 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:56.710806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:56.711429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6e316518-0d7f-48d3-a845-f6a415d12ba4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.160346 Aug 08 13:41:56.711949 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 312/644] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:41:56 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:41:57.743246 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:57.743900 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:57.751344 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:57.751831 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:57.752263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:57.752961 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:57.753405 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:57.753925 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:57.910965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:57.919991 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:57.921524 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:57.922687 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7df1b69e-be11-4019-822a-208026820192 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.183872 Aug 08 13:41:57.923254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 333/645] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:41:57 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:41:58.946328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:41:58.946971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:41:58.953998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:58.954598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:58.954927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:58.955669 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:58.956119 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:58.956537 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:59.102022 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:59.110752 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:59.112620 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:41:59.113946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-277b50d4-4a63-4f68-af62-229677be8c1a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 200 len: 1723 microversion: 2.20 time: 0.171787 Aug 08 13:41:59.114717 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 313/646] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:41:58 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:41:59.511352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-2b4d7c58-7563-4b32-b935-37ef8dbaf483 req-7a6f882a-ea1e-40ad-88ac-873bc2ad5e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b337a957-cd21-4f51-aa36-f64ad24aee7c", "name": "network-vif-deleted", "tag": "9caada1c-52b2-4c87-b709-be921f77a3b5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:41:59.527622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-2b4d7c58-7563-4b32-b935-37ef8dbaf483 req-7a6f882a-ea1e-40ad-88ac-873bc2ad5e40 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:41:59.528102 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-2b4d7c58-7563-4b32-b935-37ef8dbaf483 req-7a6f882a-ea1e-40ad-88ac-873bc2ad5e40 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:41:59.528538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-2b4d7c58-7563-4b32-b935-37ef8dbaf483 req-7a6f882a-ea1e-40ad-88ac-873bc2ad5e40 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:41:59.541431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-2b4d7c58-7563-4b32-b935-37ef8dbaf483 req-7a6f882a-ea1e-40ad-88ac-873bc2ad5e40 service nova] Creating event network-vif-deleted:9caada1c-52b2-4c87-b709-be921f77a3b5 for instance b337a957-cd21-4f51-aa36-f64ad24aee7c on hv-cinder-85199 Aug 08 13:41:59.547032 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-2b4d7c58-7563-4b32-b935-37ef8dbaf483 req-7a6f882a-ea1e-40ad-88ac-873bc2ad5e40 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040239 Aug 08 13:41:59.547667 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 334/647] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:00.138041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:00.138723 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:00.149647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:00.150456 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:00.151250 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:00.152033 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:00.152490 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:00.153098 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:00.168478 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] HTTP exception thrown: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Request method failure captured: Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c HTTP/1.1 Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REwp3NUbGlTyrrSSR2kwvstDxKh2tvyYUeIgQMhnwePf76c5dETBdbR0XAAOPEaWdM0hn5un3rW598Y8UusbWV6OTrgazdOTk8QbGemf0qg1Pt17Qz0wPG8qsd8fuSusXfBwBqh2D6LvMaJvRxZ8q-rxcMauFnWlid5T0kdsFTmvMU Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:42:00.170221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0831512491044565b17fb6dd11a57b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0831512491044565b17fb6dd11a57b5f"}]}] Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: c29ce05ebc6e4672bb9557f751a48557 Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:42:00.172135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': 'b337a957-cd21-4f51-aa36-f64ad24aee7c'} Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:42:00.173708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:42:00.175989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:00.178301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Returning 404 to user: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:42:00.178301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-796f6443-694e-43a8-a55c-d6f5db0c5327 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 404 len: 111 microversion: 2.20 time: 0.038235 Aug 08 13:42:00.178301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 314/648] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:00 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 13:42:00.188480 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-00be9939-e9b0-4189-b69b-083f903ed853 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '.version_select at 0x7f7d2425d550>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:00.212212 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-00be9939-e9b0-4189-b69b-083f903ed853 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-996692206" status: 204 len: 0 microversion: 2.20 time: 0.028139 Aug 08 13:42:00.212825 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 335/649] 10.222.0.33 () {60 vars in 1259 bytes} [Mon Aug 8 13:42:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-996692206 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 13:42:00.920836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-05e248ec-2495-47f8-897c-9ebf5438a504 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Action: 'create', calling method: .version_select at 0x7f7d241695e0>, body: {"keypair": {"name": "tempest-keypair-1725106841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDw1IhqT8YlsDnHDtUea4r+PhoOUP9nHX5Jgv4hj6QltFIWO/M0UruJTXrQIAhkQVNiR+wgpdyTx3ITWtNJkw8E+i6D5vP8hqD8ICgHcsm3LqnUBZ/pI8lem/N3EfvRZGw=="}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:00.936721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-05e248ec-2495-47f8-897c-9ebf5438a504 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Getting quotas for project 0831512491044565b17fb6dd11a57b5f. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:42:00.942536 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-05e248ec-2495-47f8-897c-9ebf5438a504 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Getting quotas for user c29ce05ebc6e4672bb9557f751a48557 and project 0831512491044565b17fb6dd11a57b5f. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:42:00.974376 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-05e248ec-2495-47f8-897c-9ebf5438a504 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.057725 Aug 08 13:42:00.974964 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 315/650] 10.222.0.33 () {62 vars in 1200 bytes} [Mon Aug 8 13:42:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 13:42:02.600858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-911396397", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5d048dd-1a56-432c-af83-8892c932e019"}], "security_groups": [{"name": "tempest-securitygroup--1932379520"}], "key_name": "tempest-keypair-1725106841", "user_data": "}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:02.706760 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] validate_networks() for [('c5d048dd-1a56-432c-af83-8892c932e019', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:42:03.092358 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:42:03.092757 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:42:03.093247 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:42:03.093650 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:42:03.094054 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:42:03.104801 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:03.105294 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:03.105846 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:03.106756 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:03.107230 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:03.107646 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:03.126810 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Getting quotas for project 0831512491044565b17fb6dd11a57b5f. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:42:03.131331 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Getting quotas for user c29ce05ebc6e4672bb9557f751a48557 and project 0831512491044565b17fb6dd11a57b5f. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:42:03.144060 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:42:03.146437 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:42:03.193072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9cd4e81d-dc10-401a-be58-020707af99e1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.597286 Aug 08 13:42:03.193729 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 336/651] 10.222.0.33 () {62 vars in 1188 bytes} [Mon Aug 8 13:42:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 13:42:03.211669 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5eb3b796-57b2-456d-a40c-f814b68a38d3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:03.213180 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5eb3b796-57b2-456d-a40c-f814b68a38d3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:03.280410 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5eb3b796-57b2-456d-a40c-f814b68a38d3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:03.291553 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5eb3b796-57b2-456d-a40c-f814b68a38d3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:03.293758 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5eb3b796-57b2-456d-a40c-f814b68a38d3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:03.295678 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5eb3b796-57b2-456d-a40c-f814b68a38d3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1281 microversion: 2.20 time: 0.092055 Aug 08 13:42:03.296698 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 316/652] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:03 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:04.322890 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:04.323691 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:04.330639 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:04.331164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:04.331739 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:04.332496 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:04.332948 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:04.333370 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:04.402706 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:04.412658 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:04.414531 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:04.415701 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3d528509-f817-4540-8a32-b2bfa2b247b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1341 microversion: 2.20 time: 0.097833 Aug 08 13:42:04.416277 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 337/653] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:04 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:05.280710 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f9d294ca-dc87-4f85-aab4-f8e6eb090517 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:05.281342 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f9d294ca-dc87-4f85-aab4-f8e6eb090517 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:05.283991 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:05.290669 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9d294ca-dc87-4f85-aab4-f8e6eb090517 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:05.291252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9d294ca-dc87-4f85-aab4-f8e6eb090517 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:05.292174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9d294ca-dc87-4f85-aab4-f8e6eb090517 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:05.293071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9d294ca-dc87-4f85-aab4-f8e6eb090517 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:05.293687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9d294ca-dc87-4f85-aab4-f8e6eb090517 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:05.294270 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9d294ca-dc87-4f85-aab4-f8e6eb090517 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:05.388443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.objects.instance [None req-f9d294ca-dc87-4f85-aab4-f8e6eb090517 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lazy-loading 'services' on Instance uuid 5f52d43d-f702-4083-8da1-ace76450a04d {{(pid=124407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:42:05.438579 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:05.439472 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:05.446152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:05.446799 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:05.447403 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:05.448583 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:05.449294 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:05.449932 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:05.468559 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f9d294ca-dc87-4f85-aab4-f8e6eb090517 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments/33e1468f-72b3-436a-953b-0ca38edce759" status: 202 len: 0 microversion: 2.1 time: 0.191926 Aug 08 13:42:05.469239 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 317/654] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:42:05 2022] DELETE /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments/33e1468f-72b3-436a-953b-0ca38edce759 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:42:05.479599 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7afc4b43-5617-4a2e-8bf8-fe525e92f708 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:05.483211 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7afc4b43-5617-4a2e-8bf8-fe525e92f708 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:05.490503 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7afc4b43-5617-4a2e-8bf8-fe525e92f708 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:05.491293 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7afc4b43-5617-4a2e-8bf8-fe525e92f708 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:05.491903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7afc4b43-5617-4a2e-8bf8-fe525e92f708 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:05.492941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7afc4b43-5617-4a2e-8bf8-fe525e92f708 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:05.494043 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7afc4b43-5617-4a2e-8bf8-fe525e92f708 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:05.494627 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7afc4b43-5617-4a2e-8bf8-fe525e92f708 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:05.536750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7afc4b43-5617-4a2e-8bf8-fe525e92f708 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062675 Aug 08 13:42:05.538674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 318/655] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:42:05 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:42:05.624451 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:05.633050 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:05.634499 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:05.635707 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6a1221e9-5666-488b-a0fe-00c0c7ce4efb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.201623 Aug 08 13:42:05.636326 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 338/656] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:05 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:42:05.951300 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-b0c38043-b4e4-4756-8fce-060d8e7c23a7 req-dcc4bc1a-2863-45a9-abb8-aab838765f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f5ea81-40a9-4734-8c39-c5f0a2a55bab", "tag": "5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:05.960890 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-b0c38043-b4e4-4756-8fce-060d8e7c23a7 req-dcc4bc1a-2863-45a9-abb8-aab838765f63 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:05.961396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-b0c38043-b4e4-4756-8fce-060d8e7c23a7 req-dcc4bc1a-2863-45a9-abb8-aab838765f63 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:05.961814 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-b0c38043-b4e4-4756-8fce-060d8e7c23a7 req-dcc4bc1a-2863-45a9-abb8-aab838765f63 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:05.972807 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-b0c38043-b4e4-4756-8fce-060d8e7c23a7 req-dcc4bc1a-2863-45a9-abb8-aab838765f63 service nova] Creating event network-changed:5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5 for instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab on hv-cinder-85199 Aug 08 13:42:05.977959 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-b0c38043-b4e4-4756-8fce-060d8e7c23a7 req-dcc4bc1a-2863-45a9-abb8-aab838765f63 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031142 Aug 08 13:42:05.978512 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 319/657] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:06.550366 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f8025fac-99fa-4e81-bc19-3299988f5609 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:06.553408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f8025fac-99fa-4e81-bc19-3299988f5609 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:06.560572 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8025fac-99fa-4e81-bc19-3299988f5609 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:06.561363 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8025fac-99fa-4e81-bc19-3299988f5609 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:06.561827 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8025fac-99fa-4e81-bc19-3299988f5609 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:06.562533 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8025fac-99fa-4e81-bc19-3299988f5609 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:06.562979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8025fac-99fa-4e81-bc19-3299988f5609 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:06.563436 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8025fac-99fa-4e81-bc19-3299988f5609 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:06.597437 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f8025fac-99fa-4e81-bc19-3299988f5609 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050983 Aug 08 13:42:06.598011 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 339/658] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:42:06 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 13:42:06.659142 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:06.659920 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:06.672027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:06.672027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:06.672027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:06.672027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:06.672519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:06.672519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:06.680456 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-36a880ee-8dfe-42e9-88a9-7012fb532f93 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:06.681026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-36a880ee-8dfe-42e9-88a9-7012fb532f93 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:06.687825 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-36a880ee-8dfe-42e9-88a9-7012fb532f93 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:06.688424 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-36a880ee-8dfe-42e9-88a9-7012fb532f93 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:06.688848 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-36a880ee-8dfe-42e9-88a9-7012fb532f93 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:06.689551 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-36a880ee-8dfe-42e9-88a9-7012fb532f93 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:06.690356 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-36a880ee-8dfe-42e9-88a9-7012fb532f93 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:06.690483 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-36a880ee-8dfe-42e9-88a9-7012fb532f93 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:06.720334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-36a880ee-8dfe-42e9-88a9-7012fb532f93 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Going to try to terminate instance {{(pid=124408) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:42:06.811933 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-36a880ee-8dfe-42e9-88a9-7012fb532f93 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 204 len: 0 microversion: 2.1 time: 0.134915 Aug 08 13:42:06.812793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 340/659] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:42:06 2022] DELETE /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:42:06.815703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:06.824349 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:06.824578 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0a75f8e5-a69d-40ac-8928-19845ef66118 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:06.825157 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0a75f8e5-a69d-40ac-8928-19845ef66118 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:06.826349 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:06.827854 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-12981808-9e3f-48d8-b52c-c7492a51c83e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.172795 Aug 08 13:42:06.828787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 320/660] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:06 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:42:06.831372 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0a75f8e5-a69d-40ac-8928-19845ef66118 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:06.831859 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0a75f8e5-a69d-40ac-8928-19845ef66118 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:06.832291 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0a75f8e5-a69d-40ac-8928-19845ef66118 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:06.832994 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0a75f8e5-a69d-40ac-8928-19845ef66118 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:06.833445 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0a75f8e5-a69d-40ac-8928-19845ef66118 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:06.833865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0a75f8e5-a69d-40ac-8928-19845ef66118 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:06.983337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0a75f8e5-a69d-40ac-8928-19845ef66118 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:06.991462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0a75f8e5-a69d-40ac-8928-19845ef66118 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1689 microversion: 2.1 time: 0.171020 Aug 08 13:42:06.992038 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 341/661] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:06 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:07.852498 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:07.853163 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:07.860678 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:07.861223 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:07.861644 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:07.862335 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:07.862776 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:07.863228 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:08.003870 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:08.012532 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:08.014058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:08.014893 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7ba0208d-8b87-47b2-adc6-b5068d9217d1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:08.015429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f866dabb-7fb6-432c-8cab-7953cf77d41c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.167388 Aug 08 13:42:08.015537 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7ba0208d-8b87-47b2-adc6-b5068d9217d1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:08.015818 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 321/662] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:07 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:08.022768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ba0208d-8b87-47b2-adc6-b5068d9217d1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:08.023524 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ba0208d-8b87-47b2-adc6-b5068d9217d1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:08.023906 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ba0208d-8b87-47b2-adc6-b5068d9217d1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:08.024721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ba0208d-8b87-47b2-adc6-b5068d9217d1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:08.025309 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ba0208d-8b87-47b2-adc6-b5068d9217d1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:08.025684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ba0208d-8b87-47b2-adc6-b5068d9217d1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:08.166550 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7ba0208d-8b87-47b2-adc6-b5068d9217d1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:08.175176 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7ba0208d-8b87-47b2-adc6-b5068d9217d1 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1689 microversion: 2.1 time: 0.164073 Aug 08 13:42:08.175750 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 342/663] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:08 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:42:09.038397 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:09.039008 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:09.046056 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:09.046529 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:09.046957 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:09.047680 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:09.048146 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:09.048542 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:09.184083 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:09.192836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:09.194322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:09.195453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-448fcecd-9f46-40f0-b324-554f366bf029 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.161120 Aug 08 13:42:09.196182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 322/664] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:09 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:09.196741 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c0a8d5c5-2b61-4bfd-8024-7647d67a7359 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:09.197372 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c0a8d5c5-2b61-4bfd-8024-7647d67a7359 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:09.204010 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0a8d5c5-2b61-4bfd-8024-7647d67a7359 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:09.204610 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0a8d5c5-2b61-4bfd-8024-7647d67a7359 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:09.205048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0a8d5c5-2b61-4bfd-8024-7647d67a7359 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:09.205748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0a8d5c5-2b61-4bfd-8024-7647d67a7359 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:09.206203 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0a8d5c5-2b61-4bfd-8024-7647d67a7359 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:09.206625 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0a8d5c5-2b61-4bfd-8024-7647d67a7359 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:09.348972 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c0a8d5c5-2b61-4bfd-8024-7647d67a7359 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:09.357816 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c0a8d5c5-2b61-4bfd-8024-7647d67a7359 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1689 microversion: 2.1 time: 0.164963 Aug 08 13:42:09.358406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 343/665] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:09 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:10.220496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:10.221102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:10.229717 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:10.230193 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:10.230618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:10.231341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:10.231826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:10.232251 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:10.378136 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:10.380902 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fb1d2751-0803-4935-89d7-ec0176c72839 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:10.381477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fb1d2751-0803-4935-89d7-ec0176c72839 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:10.389390 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb1d2751-0803-4935-89d7-ec0176c72839 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:10.389663 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:10.389871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb1d2751-0803-4935-89d7-ec0176c72839 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:10.390376 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb1d2751-0803-4935-89d7-ec0176c72839 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:10.391106 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb1d2751-0803-4935-89d7-ec0176c72839 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:10.391575 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb1d2751-0803-4935-89d7-ec0176c72839 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:10.391698 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:10.392044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb1d2751-0803-4935-89d7-ec0176c72839 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:10.393427 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7e009ccb-386c-43ed-961d-b37bc9c70587 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.177275 Aug 08 13:42:10.394385 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 323/666] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:10 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:42:10.533590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fb1d2751-0803-4935-89d7-ec0176c72839 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:10.542398 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fb1d2751-0803-4935-89d7-ec0176c72839 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1689 microversion: 2.1 time: 0.165486 Aug 08 13:42:10.543204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 344/667] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:10 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:11.417956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:11.418592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:11.425574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:11.426057 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:11.426480 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:11.427179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:11.427623 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:11.428065 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:11.570217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:11.572339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3009af1c-4303-4908-9b88-d5d63f8e2f6e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:11.572339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3009af1c-4303-4908-9b88-d5d63f8e2f6e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:11.577262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:11.577795 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3009af1c-4303-4908-9b88-d5d63f8e2f6e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:11.578320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3009af1c-4303-4908-9b88-d5d63f8e2f6e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:11.578719 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:11.578825 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3009af1c-4303-4908-9b88-d5d63f8e2f6e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:11.579607 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3009af1c-4303-4908-9b88-d5d63f8e2f6e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:11.579885 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3e12552e-01f7-4bdd-af67-de65bd6bf63f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.166476 Aug 08 13:42:11.580517 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3009af1c-4303-4908-9b88-d5d63f8e2f6e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:11.580664 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 324/668] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:11 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:11.580776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3009af1c-4303-4908-9b88-d5d63f8e2f6e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:11.721332 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3009af1c-4303-4908-9b88-d5d63f8e2f6e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:11.724891 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:11.730194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3009af1c-4303-4908-9b88-d5d63f8e2f6e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1689 microversion: 2.1 time: 0.164499 Aug 08 13:42:11.730777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 345/669] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:11 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:42:12.602854 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:12.603466 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:12.610072 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:12.610553 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:12.610986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:12.611707 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:12.612151 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:12.612571 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:12.753484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ec2f06e2-a47d-4832-b1b2-7cd70e76ab61 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:12.754566 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ec2f06e2-a47d-4832-b1b2-7cd70e76ab61 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:12.763968 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec2f06e2-a47d-4832-b1b2-7cd70e76ab61 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:12.764457 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec2f06e2-a47d-4832-b1b2-7cd70e76ab61 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:12.764880 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec2f06e2-a47d-4832-b1b2-7cd70e76ab61 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:12.765590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec2f06e2-a47d-4832-b1b2-7cd70e76ab61 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:12.766032 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec2f06e2-a47d-4832-b1b2-7cd70e76ab61 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:12.766451 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ec2f06e2-a47d-4832-b1b2-7cd70e76ab61 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:12.772487 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:12.780759 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:12.782286 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:12.783515 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c639e9cf-d32c-4895-8915-40b0f4b5f2bb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.184961 Aug 08 13:42:12.784069 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 325/670] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:12 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:12.904093 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ec2f06e2-a47d-4832-b1b2-7cd70e76ab61 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:12.911942 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ec2f06e2-a47d-4832-b1b2-7cd70e76ab61 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1689 microversion: 2.1 time: 0.163975 Aug 08 13:42:12.912495 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 346/671] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:12 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:42:13.740312 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-8a7c2a9b-9664-4b2a-b6b4-d0624fbd553e req-ed463465-3ae0-4c21-acf1-b66b76b3f54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f52d43d-f702-4083-8da1-ace76450a04d", "name": "network-vif-deleted", "tag": "d64f2955-ff2d-41e6-bb65-c24de3c861ef"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:13.746242 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:13.752578 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-8a7c2a9b-9664-4b2a-b6b4-d0624fbd553e req-ed463465-3ae0-4c21-acf1-b66b76b3f54f service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:13.753077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-8a7c2a9b-9664-4b2a-b6b4-d0624fbd553e req-ed463465-3ae0-4c21-acf1-b66b76b3f54f service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:13.753586 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-8a7c2a9b-9664-4b2a-b6b4-d0624fbd553e req-ed463465-3ae0-4c21-acf1-b66b76b3f54f service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:13.765297 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-8a7c2a9b-9664-4b2a-b6b4-d0624fbd553e req-ed463465-3ae0-4c21-acf1-b66b76b3f54f service nova] Creating event network-vif-deleted:d64f2955-ff2d-41e6-bb65-c24de3c861ef for instance 5f52d43d-f702-4083-8da1-ace76450a04d on hv-cinder-85199 Aug 08 13:42:13.776315 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-8a7c2a9b-9664-4b2a-b6b4-d0624fbd553e req-ed463465-3ae0-4c21-acf1-b66b76b3f54f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039703 Aug 08 13:42:13.776933 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 326/672] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:13.809707 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:13.810324 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:13.813688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:13.814850 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:13.818894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:13.819454 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:13.820369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:13.821408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:13.821863 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:13.822476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:13.934788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:13.935844 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:13.961172 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:13.961786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:13.962427 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:13.963329 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:13.964034 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:13.964722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:13.993838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:14.006192 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:14.008608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:14.015982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f0dac1f1-bd54-435b-9564-966abce6c070 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.212293 Aug 08 13:42:14.017151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 347/673] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:13 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:14.019891 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:14.020500 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:14.021133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:14.021617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.objects.instance [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lazy-loading 'fault' on Instance uuid 5f52d43d-f702-4083-8da1-ace76450a04d {{(pid=124407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:42:14.065984 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:14.069830 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:14.075179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b423ad13-9617-4f0c-906d-33119beb4294 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 200 len: 1335 microversion: 2.1 time: 0.144870 Aug 08 13:42:14.075763 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 327/674] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:13 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 1335 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:42:15.040267 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:15.041174 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:15.048199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:15.048684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:15.049140 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:15.049889 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:15.050322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:15.050782 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:15.097021 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:15.097708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: 5f52d43d-f702-4083-8da1-ace76450a04d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:15.106494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:15.106981 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:15.107696 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:15.108619 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:15.109067 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:15.109483 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:15.124985 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] HTTP exception thrown: Instance 5f52d43d-f702-4083-8da1-ace76450a04d could not be found. Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Request method failure captured: Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d HTTP/1.1 Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REf1Ea14AYR1pE2a6K4N54fc0_x21TT0v6rOqtzgzhFTlqzH2mLPOhcT2JRzQ__W3s8-mQbJ-2jCAvD7htLjrZXdatV8tQuLIFbwXboRqq9yI-tUt4OQZMNTlEmgJXenIgfvcMxbcNgSLDSG6kCzX_3jRFF8WtZW-BF7nLZaWhtqiA Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: f90db8c721374e0fb3a037661b3d9fe0 Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:42:15.127133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f90db8c721374e0fb3a037661b3d9fe0"}]}] Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: f90db8c721374e0fb3a037661b3d9fe0 Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-ServerRescueNegativeTestJSON-1645977264-project Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: 518d6948777944fd8214dc6d778a9a02 Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1645977264-project Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 5f52d43d-f702-4083-8da1-ace76450a04d could not be found. Aug 08 13:42:15.129734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '5f52d43d-f702-4083-8da1-ace76450a04d'} Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f52d43d-f702-4083-8da1-ace76450a04d could not be found. Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:42:15.131202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f52d43d-f702-4083-8da1-ace76450a04d could not be found. Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f52d43d-f702-4083-8da1-ace76450a04d could not be found. Aug 08 13:42:15.133509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:15.139442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Returning 404 to user: Instance 5f52d43d-f702-4083-8da1-ace76450a04d could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:42:15.139442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5dffffbc-c2aa-49e9-afc8-8b101e2345a7 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d" status: 404 len: 111 microversion: 2.1 time: 0.035730 Aug 08 13:42:15.139442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 328/675] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:15 2022] GET /compute/v2.1/servers/5f52d43d-f702-4083-8da1-ace76450a04d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:42:15.139442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f5db93dd-3707-4d5a-ad4f-1ed9d735e840 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '.version_select at 0x7f7d24273d30>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:15.164742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f5db93dd-3707-4d5a-ad4f-1ed9d735e840 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037712942" status: 202 len: 0 microversion: 2.1 time: 0.030582 Aug 08 13:42:15.165974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 329/676] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Aug 8 13:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037712942 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:42:15.223471 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:15.233199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:15.235101 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:15.236510 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-5fc310b8-e986-4173-9b26-881580548bb7 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.200285 Aug 08 13:42:15.237454 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 348/677] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:15 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:16.263022 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:16.263879 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:16.273320 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:16.273320 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:16.273980 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:16.275100 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:16.275622 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:16.276046 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:16.421710 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:16.430530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:16.432045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:16.433133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-67bf4e9e-4f95-464e-bc1e-b017dd1e8c89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.176960 Aug 08 13:42:16.433717 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 330/678] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:16 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:17.254614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-0361a480-d539-4108-b2cc-3a71b2198b05 req-a2f87cf8-3239-4fbc-b88c-3032d39c2441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f5ea81-40a9-4734-8c39-c5f0a2a55bab", "name": "network-vif-plugged", "status": "completed", "tag": "5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:17.266673 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-0361a480-d539-4108-b2cc-3a71b2198b05 req-a2f87cf8-3239-4fbc-b88c-3032d39c2441 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:17.267173 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-0361a480-d539-4108-b2cc-3a71b2198b05 req-a2f87cf8-3239-4fbc-b88c-3032d39c2441 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:17.267602 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-0361a480-d539-4108-b2cc-3a71b2198b05 req-a2f87cf8-3239-4fbc-b88c-3032d39c2441 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:17.281311 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-0361a480-d539-4108-b2cc-3a71b2198b05 req-a2f87cf8-3239-4fbc-b88c-3032d39c2441 service nova] Creating event network-vif-plugged:5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5 for instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab on hv-cinder-85199 Aug 08 13:42:17.286602 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-0361a480-d539-4108-b2cc-3a71b2198b05 req-a2f87cf8-3239-4fbc-b88c-3032d39c2441 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036433 Aug 08 13:42:17.287235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 349/679] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:17.455140 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:17.455777 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:17.463209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:17.463705 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:17.464179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:17.464962 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:17.465440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:17.465909 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:17.606174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:17.614708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:17.616277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:17.617527 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a19c99de-06fe-43b4-9fc9-f5ee6145f767 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.166372 Aug 08 13:42:17.618118 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 331/680] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:17 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:18.178016 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c0c98e0b-5d4f-42ae-b31f-26dd201b05da tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:18.178595 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c0c98e0b-5d4f-42ae-b31f-26dd201b05da tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:18.185156 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0c98e0b-5d4f-42ae-b31f-26dd201b05da tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:18.185777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0c98e0b-5d4f-42ae-b31f-26dd201b05da tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:18.190333 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0c98e0b-5d4f-42ae-b31f-26dd201b05da tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:18.191068 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0c98e0b-5d4f-42ae-b31f-26dd201b05da tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:18.191560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0c98e0b-5d4f-42ae-b31f-26dd201b05da tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:18.192006 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c0c98e0b-5d4f-42ae-b31f-26dd201b05da tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:18.221370 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c0c98e0b-5d4f-42ae-b31f-26dd201b05da tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Going to try to terminate instance {{(pid=124408) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:42:18.304261 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c0c98e0b-5d4f-42ae-b31f-26dd201b05da tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 204 len: 0 microversion: 2.1 time: 0.130872 Aug 08 13:42:18.304982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 350/681] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:42:18 2022] DELETE /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:42:18.313018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e30e312d-dca4-4255-92b1-8d20bb595e54 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:18.313618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e30e312d-dca4-4255-92b1-8d20bb595e54 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:18.319817 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e30e312d-dca4-4255-92b1-8d20bb595e54 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:18.320295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e30e312d-dca4-4255-92b1-8d20bb595e54 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:18.320726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e30e312d-dca4-4255-92b1-8d20bb595e54 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:18.321407 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e30e312d-dca4-4255-92b1-8d20bb595e54 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:18.321854 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e30e312d-dca4-4255-92b1-8d20bb595e54 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:18.322274 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e30e312d-dca4-4255-92b1-8d20bb595e54 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:18.463791 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e30e312d-dca4-4255-92b1-8d20bb595e54 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:18.471430 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e30e312d-dca4-4255-92b1-8d20bb595e54 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1507 microversion: 2.1 time: 0.162303 Aug 08 13:42:18.471959 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 332/682] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:18 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:18.642854 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:18.643481 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:18.649659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:18.650142 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:18.650552 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:18.651309 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:18.651759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:18.652174 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:18.788043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:18.796142 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:18.797622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:18.798720 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-546cfdf8-3b63-4ad9-bf13-69869e87b4f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1407 microversion: 2.20 time: 0.160841 Aug 08 13:42:18.799306 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 351/683] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:18 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:19.492942 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b56b399d-981e-46fb-94af-0b91685d04fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:19.493540 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b56b399d-981e-46fb-94af-0b91685d04fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:19.500591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b56b399d-981e-46fb-94af-0b91685d04fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:19.501076 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b56b399d-981e-46fb-94af-0b91685d04fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:19.501510 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b56b399d-981e-46fb-94af-0b91685d04fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:19.502215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b56b399d-981e-46fb-94af-0b91685d04fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:19.502665 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b56b399d-981e-46fb-94af-0b91685d04fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:19.503125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b56b399d-981e-46fb-94af-0b91685d04fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:19.638215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b56b399d-981e-46fb-94af-0b91685d04fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:19.645820 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b56b399d-981e-46fb-94af-0b91685d04fc tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1507 microversion: 2.1 time: 0.156850 Aug 08 13:42:19.646452 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 333/684] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:19 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:19.823626 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:19.824240 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:19.831766 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:19.832254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:19.832686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:19.833378 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:19.833828 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:19.834249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:19.970826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:19.979835 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:19.981335 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:19.982670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bb59c569-5050-4d7f-870c-043e19a3c9db tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1600 microversion: 2.20 time: 0.164499 Aug 08 13:42:19.983288 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 352/685] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:42:19 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:42:20.004743 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6f293eea-d4b1-4316-a466-b910b7f2d4a3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:20.005231 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6f293eea-d4b1-4316-a466-b910b7f2d4a3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:20.011495 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f293eea-d4b1-4316-a466-b910b7f2d4a3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:20.011981 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f293eea-d4b1-4316-a466-b910b7f2d4a3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:20.012411 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f293eea-d4b1-4316-a466-b910b7f2d4a3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:20.013102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f293eea-d4b1-4316-a466-b910b7f2d4a3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:20.013551 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f293eea-d4b1-4316-a466-b910b7f2d4a3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:20.014013 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f293eea-d4b1-4316-a466-b910b7f2d4a3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:20.090367 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6f293eea-d4b1-4316-a466-b910b7f2d4a3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089431 Aug 08 13:42:20.091107 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 334/686] 10.222.0.33 () {60 vars in 1316 bytes} [Mon Aug 8 13:42:19 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:42:20.667306 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e4059871-efb8-4ec3-9fdd-e751616de15b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:20.667917 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e4059871-efb8-4ec3-9fdd-e751616de15b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:20.674659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e4059871-efb8-4ec3-9fdd-e751616de15b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:20.675154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e4059871-efb8-4ec3-9fdd-e751616de15b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:20.675591 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e4059871-efb8-4ec3-9fdd-e751616de15b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:20.676305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e4059871-efb8-4ec3-9fdd-e751616de15b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:20.676756 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e4059871-efb8-4ec3-9fdd-e751616de15b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:20.677176 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e4059871-efb8-4ec3-9fdd-e751616de15b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:20.821962 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e4059871-efb8-4ec3-9fdd-e751616de15b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:20.830965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e4059871-efb8-4ec3-9fdd-e751616de15b tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1507 microversion: 2.1 time: 0.167659 Aug 08 13:42:20.839126 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 353/687] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:20 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:21.630316 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-654a1bc6-2a7e-4bfa-8005-9f70476f99f9 req-cd3c11c9-4401-4fc8-9ff1-c510864dc9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ef4518-23e7-4182-8a95-59a287fe5eff", "name": "network-vif-deleted", "tag": "ff67f5bc-bd23-4f24-bcc8-fb3ea1bcb89b"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:21.640866 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-654a1bc6-2a7e-4bfa-8005-9f70476f99f9 req-cd3c11c9-4401-4fc8-9ff1-c510864dc9d4 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:21.641623 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-654a1bc6-2a7e-4bfa-8005-9f70476f99f9 req-cd3c11c9-4401-4fc8-9ff1-c510864dc9d4 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:21.642026 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-654a1bc6-2a7e-4bfa-8005-9f70476f99f9 req-cd3c11c9-4401-4fc8-9ff1-c510864dc9d4 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:21.653850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-654a1bc6-2a7e-4bfa-8005-9f70476f99f9 req-cd3c11c9-4401-4fc8-9ff1-c510864dc9d4 service nova] Creating event network-vif-deleted:ff67f5bc-bd23-4f24-bcc8-fb3ea1bcb89b for instance a4ef4518-23e7-4182-8a95-59a287fe5eff on hv-cinder-85199 Aug 08 13:42:21.660185 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-654a1bc6-2a7e-4bfa-8005-9f70476f99f9 req-cd3c11c9-4401-4fc8-9ff1-c510864dc9d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034007 Aug 08 13:42:21.661275 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 335/688] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:21.852761 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:21.853300 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:21.860273 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:21.860855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:21.861359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:21.862136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:21.862658 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:21.863168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:21.898971 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:21.899482 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:21.899917 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:21.900369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lazy-loading 'fault' on Instance uuid a4ef4518-23e7-4182-8a95-59a287fe5eff {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:42:21.943380 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:21.956686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-40ba2563-6c08-480d-92ae-c1288f3022b5 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 200 len: 1311 microversion: 2.1 time: 0.108217 Aug 08 13:42:21.957478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 354/689] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:21 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:22.980489 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:22.981045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: a4ef4518-23e7-4182-8a95-59a287fe5eff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:22.987757 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:22.988240 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:22.988673 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:22.989359 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:22.989804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:22.990218 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:23.004147 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] HTTP exception thrown: Instance a4ef4518-23e7-4182-8a95-59a287fe5eff could not be found. Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Request method failure captured: Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff HTTP/1.1 Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REf1Ea14AYR1pE2a6K4N54fc0_x21TT0v6rOqtzgzhFTlqzH2mLPOhcT2JRzQ__W3s8-mQbJ-2jCAvD7htLjrZXdatV8tQuLIFbwXboRqq9yI-tUt4OQZMNTlEmgJXenIgfvcMxbcNgSLDSG6kCzX_3jRFF8WtZW-BF7nLZaWhtqiA Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: f90db8c721374e0fb3a037661b3d9fe0 Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:42:23.005746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f90db8c721374e0fb3a037661b3d9fe0"}]}] Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: f90db8c721374e0fb3a037661b3d9fe0 Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-ServerRescueNegativeTestJSON-1645977264-project Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: 518d6948777944fd8214dc6d778a9a02 Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1645977264-project Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance a4ef4518-23e7-4182-8a95-59a287fe5eff could not be found. Aug 08 13:42:23.007068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': 'a4ef4518-23e7-4182-8a95-59a287fe5eff'} Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ef4518-23e7-4182-8a95-59a287fe5eff could not be found. Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:42:23.007852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ef4518-23e7-4182-8a95-59a287fe5eff could not be found. Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ef4518-23e7-4182-8a95-59a287fe5eff could not be found. Aug 08 13:42:23.009032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:23.010401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Returning 404 to user: Instance a4ef4518-23e7-4182-8a95-59a287fe5eff could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:42:23.010401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3cf76f7d-830e-4899-87f5-f2c2a4615f1c tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff" status: 404 len: 111 microversion: 2.1 time: 0.031953 Aug 08 13:42:23.010401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 336/690] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:22 2022] GET /compute/v2.1/servers/a4ef4518-23e7-4182-8a95-59a287fe5eff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:42:23.017143 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0040971d-0335-4092-b995-b03a0c600375 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:23.017649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0040971d-0335-4092-b995-b03a0c600375 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:23.024924 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0040971d-0335-4092-b995-b03a0c600375 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:23.025510 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0040971d-0335-4092-b995-b03a0c600375 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:23.026123 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0040971d-0335-4092-b995-b03a0c600375 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:23.026823 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0040971d-0335-4092-b995-b03a0c600375 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:23.027373 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0040971d-0335-4092-b995-b03a0c600375 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:23.027948 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0040971d-0335-4092-b995-b03a0c600375 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:23.055347 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0040971d-0335-4092-b995-b03a0c600375 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Going to try to terminate instance {{(pid=124408) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:42:23.139373 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0040971d-0335-4092-b995-b03a0c600375 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 204 len: 0 microversion: 2.1 time: 0.126612 Aug 08 13:42:23.139988 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 355/691] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:42:23 2022] DELETE /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:42:23.148602 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8ce8effd-6646-4802-969d-c5914e8cb4a9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:23.149207 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8ce8effd-6646-4802-969d-c5914e8cb4a9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:23.155482 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ce8effd-6646-4802-969d-c5914e8cb4a9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:23.155958 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ce8effd-6646-4802-969d-c5914e8cb4a9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:23.156388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ce8effd-6646-4802-969d-c5914e8cb4a9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:23.157076 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ce8effd-6646-4802-969d-c5914e8cb4a9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:23.157522 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ce8effd-6646-4802-969d-c5914e8cb4a9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:23.157935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8ce8effd-6646-4802-969d-c5914e8cb4a9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:23.301507 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8ce8effd-6646-4802-969d-c5914e8cb4a9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:23.312328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8ce8effd-6646-4802-969d-c5914e8cb4a9 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.167756 Aug 08 13:42:23.312911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 337/692] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:23 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:23.695804 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-eba428d6-dd65-4950-924a-9b60c562e66a req-384d2050-f4f1-4453-8dba-7a57cbc03ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f5ea81-40a9-4734-8c39-c5f0a2a55bab", "tag": "5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:23.707065 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-eba428d6-dd65-4950-924a-9b60c562e66a req-384d2050-f4f1-4453-8dba-7a57cbc03ceb service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:23.707567 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-eba428d6-dd65-4950-924a-9b60c562e66a req-384d2050-f4f1-4453-8dba-7a57cbc03ceb service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:23.707972 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-eba428d6-dd65-4950-924a-9b60c562e66a req-384d2050-f4f1-4453-8dba-7a57cbc03ceb service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:23.719483 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-eba428d6-dd65-4950-924a-9b60c562e66a req-384d2050-f4f1-4453-8dba-7a57cbc03ceb service nova] Creating event network-changed:5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5 for instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab on hv-cinder-85199 Aug 08 13:42:23.724368 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-eba428d6-dd65-4950-924a-9b60c562e66a req-384d2050-f4f1-4453-8dba-7a57cbc03ceb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034796 Aug 08 13:42:23.724957 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 356/693] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:24.336645 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8d694a44-8f41-4859-ab7d-2a8da544bbed tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:24.337385 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8d694a44-8f41-4859-ab7d-2a8da544bbed tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:24.345911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d694a44-8f41-4859-ab7d-2a8da544bbed tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:24.346889 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d694a44-8f41-4859-ab7d-2a8da544bbed tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:24.347353 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d694a44-8f41-4859-ab7d-2a8da544bbed tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:24.348049 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d694a44-8f41-4859-ab7d-2a8da544bbed tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:24.348494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d694a44-8f41-4859-ab7d-2a8da544bbed tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:24.348914 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8d694a44-8f41-4859-ab7d-2a8da544bbed tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:24.495602 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8d694a44-8f41-4859-ab7d-2a8da544bbed tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:24.503825 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8d694a44-8f41-4859-ab7d-2a8da544bbed tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.171831 Aug 08 13:42:24.504419 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 338/694] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:24 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:25.526673 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c7124ab4-8e70-44ad-9f7d-35c43bab8c9e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:25.528511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c7124ab4-8e70-44ad-9f7d-35c43bab8c9e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:25.537815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7124ab4-8e70-44ad-9f7d-35c43bab8c9e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:25.538561 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7124ab4-8e70-44ad-9f7d-35c43bab8c9e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:25.539220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7124ab4-8e70-44ad-9f7d-35c43bab8c9e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:25.540250 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7124ab4-8e70-44ad-9f7d-35c43bab8c9e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:25.540810 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7124ab4-8e70-44ad-9f7d-35c43bab8c9e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:25.541334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7124ab4-8e70-44ad-9f7d-35c43bab8c9e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:25.689925 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c7124ab4-8e70-44ad-9f7d-35c43bab8c9e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:25.700859 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c7124ab4-8e70-44ad-9f7d-35c43bab8c9e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1520 microversion: 2.1 time: 0.178921 Aug 08 13:42:25.701491 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 357/695] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:25 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:26.586291 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-ab006dfe-6229-4526-bfbc-e3764fa973c7 req-7805a3ed-0802-42a6-9399-1b133e3ca936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff259851-1c4f-411c-b555-ded6a785a91d", "name": "network-vif-deleted", "tag": "9faa6157-ecf9-4af1-8d81-b0aeaca39586"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:26.597889 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-ab006dfe-6229-4526-bfbc-e3764fa973c7 req-7805a3ed-0802-42a6-9399-1b133e3ca936 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:26.598361 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-ab006dfe-6229-4526-bfbc-e3764fa973c7 req-7805a3ed-0802-42a6-9399-1b133e3ca936 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:26.598779 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-ab006dfe-6229-4526-bfbc-e3764fa973c7 req-7805a3ed-0802-42a6-9399-1b133e3ca936 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:26.611480 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-ab006dfe-6229-4526-bfbc-e3764fa973c7 req-7805a3ed-0802-42a6-9399-1b133e3ca936 service nova] Creating event network-vif-deleted:9faa6157-ecf9-4af1-8d81-b0aeaca39586 for instance ff259851-1c4f-411c-b555-ded6a785a91d on hv-cinder-85199 Aug 08 13:42:26.617190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-ab006dfe-6229-4526-bfbc-e3764fa973c7 req-7805a3ed-0802-42a6-9399-1b133e3ca936 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034944 Aug 08 13:42:26.617851 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 339/696] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:26.722694 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:26.723977 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:26.726936 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:26.732654 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:26.733161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:26.733576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:26.734352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:26.734805 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:26.735266 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:26.769252 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:26.769733 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:26.770167 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:26.770619 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lazy-loading 'fault' on Instance uuid ff259851-1c4f-411c-b555-ded6a785a91d {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:42:26.812768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518d6948777944fd8214dc6d778a9a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90db8c721374e0fb3a037661b3d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:26.823490 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-cee6767c-b559-4d97-ba67-8d8ac7515e7e tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 200 len: 1310 microversion: 2.1 time: 0.104508 Aug 08 13:42:26.824358 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 358/697] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:26 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 1310 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:27.846716 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:27.847414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] [instance: ff259851-1c4f-411c-b555-ded6a785a91d] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:27.855111 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:27.855596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:27.856028 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:27.856714 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:27.857157 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:27.857573 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:27.872144 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] HTTP exception thrown: Instance ff259851-1c4f-411c-b555-ded6a785a91d could not be found. Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Request method failure captured: Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d HTTP/1.1 Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REf1Ea14AYR1pE2a6K4N54fc0_x21TT0v6rOqtzgzhFTlqzH2mLPOhcT2JRzQ__W3s8-mQbJ-2jCAvD7htLjrZXdatV8tQuLIFbwXboRqq9yI-tUt4OQZMNTlEmgJXenIgfvcMxbcNgSLDSG6kCzX_3jRFF8WtZW-BF7nLZaWhtqiA Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: f90db8c721374e0fb3a037661b3d9fe0 Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:42:27.873800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f90db8c721374e0fb3a037661b3d9fe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f90db8c721374e0fb3a037661b3d9fe0"}]}] Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: f90db8c721374e0fb3a037661b3d9fe0 Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1645977264 Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-ServerRescueNegativeTestJSON-1645977264-project Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: 518d6948777944fd8214dc6d778a9a02 Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1645977264-project Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance ff259851-1c4f-411c-b555-ded6a785a91d could not be found. Aug 08 13:42:27.876412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': 'ff259851-1c4f-411c-b555-ded6a785a91d'} Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff259851-1c4f-411c-b555-ded6a785a91d could not be found. Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:42:27.877803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff259851-1c4f-411c-b555-ded6a785a91d could not be found. Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff259851-1c4f-411c-b555-ded6a785a91d could not be found. Aug 08 13:42:27.880224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:42:27.883165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] Returning 404 to user: Instance ff259851-1c4f-411c-b555-ded6a785a91d could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:42:27.883165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d87c1914-a75c-4045-9e40-186a491ed342 tempest-ServerRescueNegativeTestJSON-1645977264 tempest-ServerRescueNegativeTestJSON-1645977264-project] 10.222.0.33 "GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d" status: 404 len: 111 microversion: 2.1 time: 0.032907 Aug 08 13:42:27.883165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 340/698] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:27 2022] GET /compute/v2.1/servers/ff259851-1c4f-411c-b555-ded6a785a91d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:42:33.132608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4c2b7634-680b-4660-b61c-1b6fd2c165ef tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:33.134699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4c2b7634-680b-4660-b61c-1b6fd2c165ef tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:33.141541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c2b7634-680b-4660-b61c-1b6fd2c165ef tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:33.142039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c2b7634-680b-4660-b61c-1b6fd2c165ef tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:33.142458 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c2b7634-680b-4660-b61c-1b6fd2c165ef tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:33.143199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c2b7634-680b-4660-b61c-1b6fd2c165ef tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:33.143652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c2b7634-680b-4660-b61c-1b6fd2c165ef tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:33.144066 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4c2b7634-680b-4660-b61c-1b6fd2c165ef tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:33.173568 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:33.179194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4c2b7634-680b-4660-b61c-1b6fd2c165ef tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050555 Aug 08 13:42:33.179791 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 359/699] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:42:33 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 13:42:33.248214 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5b033efc-349c-4c6c-afec-1de977bb3f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:33.248799 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5b033efc-349c-4c6c-afec-1de977bb3f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:33.255583 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b033efc-349c-4c6c-afec-1de977bb3f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:33.256070 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b033efc-349c-4c6c-afec-1de977bb3f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:33.256500 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b033efc-349c-4c6c-afec-1de977bb3f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:33.257199 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b033efc-349c-4c6c-afec-1de977bb3f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:33.257674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b033efc-349c-4c6c-afec-1de977bb3f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:33.258087 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b033efc-349c-4c6c-afec-1de977bb3f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:33.284852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5b033efc-349c-4c6c-afec-1de977bb3f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:42:33.379634 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5b033efc-349c-4c6c-afec-1de977bb3f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 204 len: 0 microversion: 2.1 time: 0.135079 Aug 08 13:42:33.381319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 341/700] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:42:33 2022] DELETE /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:42:33.391105 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0d294b3b-dcf5-4c6d-b135-c6a067419821 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:33.391727 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0d294b3b-dcf5-4c6d-b135-c6a067419821 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:33.398885 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d294b3b-dcf5-4c6d-b135-c6a067419821 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:33.399409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d294b3b-dcf5-4c6d-b135-c6a067419821 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:33.399847 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d294b3b-dcf5-4c6d-b135-c6a067419821 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:33.400552 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d294b3b-dcf5-4c6d-b135-c6a067419821 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:33.401192 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d294b3b-dcf5-4c6d-b135-c6a067419821 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:33.401620 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d294b3b-dcf5-4c6d-b135-c6a067419821 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:33.546657 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0d294b3b-dcf5-4c6d-b135-c6a067419821 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:33.558609 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0d294b3b-dcf5-4c6d-b135-c6a067419821 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1673 microversion: 2.1 time: 0.171069 Aug 08 13:42:33.559633 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 360/701] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:33 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:34.588069 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ca1f848c-5bee-4e50-b094-68d0647d1d26 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:34.588771 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ca1f848c-5bee-4e50-b094-68d0647d1d26 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:34.596382 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca1f848c-5bee-4e50-b094-68d0647d1d26 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:34.596866 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca1f848c-5bee-4e50-b094-68d0647d1d26 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:34.597286 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca1f848c-5bee-4e50-b094-68d0647d1d26 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:34.598098 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca1f848c-5bee-4e50-b094-68d0647d1d26 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:34.598635 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca1f848c-5bee-4e50-b094-68d0647d1d26 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:34.599060 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca1f848c-5bee-4e50-b094-68d0647d1d26 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:34.739952 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ca1f848c-5bee-4e50-b094-68d0647d1d26 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:34.747986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ca1f848c-5bee-4e50-b094-68d0647d1d26 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1673 microversion: 2.1 time: 0.164289 Aug 08 13:42:34.748659 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 342/702] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:34 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:42:35.770642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-cf4e1391-fe69-4995-a37a-a779434e138f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:35.771472 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-cf4e1391-fe69-4995-a37a-a779434e138f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:35.778327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cf4e1391-fe69-4995-a37a-a779434e138f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:35.778842 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cf4e1391-fe69-4995-a37a-a779434e138f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:35.779308 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cf4e1391-fe69-4995-a37a-a779434e138f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:35.780030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cf4e1391-fe69-4995-a37a-a779434e138f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:35.780492 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cf4e1391-fe69-4995-a37a-a779434e138f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:35.780940 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cf4e1391-fe69-4995-a37a-a779434e138f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:35.852528 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-cf4e1391-fe69-4995-a37a-a779434e138f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:35.861914 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-cf4e1391-fe69-4995-a37a-a779434e138f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 200 len: 1605 microversion: 2.1 time: 0.095273 Aug 08 13:42:35.877149 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 361/703] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:35 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 1605 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:36.035026 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-c9e7e329-f794-48c8-bd0f-bb3eea05243d req-94b64874-c609-4db8-8ef6-c84b3f7dec46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195b877-5ac0-4c2f-94b0-6afebf0a0ad9", "name": "network-vif-deleted", "tag": "2bfebcac-007b-41e0-a9b7-10b445528bcf"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:36.042264 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:36.050644 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-c9e7e329-f794-48c8-bd0f-bb3eea05243d req-94b64874-c609-4db8-8ef6-c84b3f7dec46 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:36.051941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-c9e7e329-f794-48c8-bd0f-bb3eea05243d req-94b64874-c609-4db8-8ef6-c84b3f7dec46 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:36.052676 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-c9e7e329-f794-48c8-bd0f-bb3eea05243d req-94b64874-c609-4db8-8ef6-c84b3f7dec46 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:36.068185 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-c9e7e329-f794-48c8-bd0f-bb3eea05243d req-94b64874-c609-4db8-8ef6-c84b3f7dec46 service nova] Creating event network-vif-deleted:2bfebcac-007b-41e0-a9b7-10b445528bcf for instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 on hv-cinder-85199 Aug 08 13:42:36.074994 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-c9e7e329-f794-48c8-bd0f-bb3eea05243d req-94b64874-c609-4db8-8ef6-c84b3f7dec46 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043680 Aug 08 13:42:36.076332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 343/704] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:36.885571 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:36.886332 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:36.893045 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:36.893857 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:36.894284 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:36.895036 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:36.895554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:36.895972 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:36.914201 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] HTTP exception thrown: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Request method failure captured: Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 HTTP/1.1 Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REiAjcTAJC8QYW7CuJxlzGS1oUHLw3a-fySBXCZLWAHn7MEXKmVns_D4s_KpcvZ5gxC87yAdtUJnc3yAuvu208DlniMDVSjHk1F6iWWCBqxsBg-xkhe6K4GjLvg2-FG-_yHlFUImwCUvOKlNqUo4H4DQ9a4dGYdMNd5gRDt3L7GgjY Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 643240773a5840d3af2622469d696beb Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:42:36.916282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_643240773a5840d3af2622469d696beb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/643240773a5840d3af2622469d696beb"}]}] Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 643240773a5840d3af2622469d696beb Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: 651659e941044454985b2f866b791b07 Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:42:36.917867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '3195b877-5ac0-4c2f-94b0-6afebf0a0ad9'} Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:42:36.918790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:42:36.924233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:42:36.925493 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Returning 404 to user: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:42:36.925493 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a883d203-44db-49e2-b801-23a1331a6395 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 404 len: 111 microversion: 2.1 time: 0.037318 Aug 08 13:42:36.925493 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 362/705] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:36 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:42:36.930060 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5c7a48c7-f616-45c5-8d7f-203f23bf8304 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '.version_select at 0x7f7d243f0040>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:36.956592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5c7a48c7-f616-45c5-8d7f-203f23bf8304 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180825876" status: 202 len: 0 microversion: 2.1 time: 0.032359 Aug 08 13:42:36.958360 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 344/706] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Aug 8 13:42:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180825876 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:42:37.659356 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-25c265bb-deba-4778-b5ac-66812cf8a5b7 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'create', calling method: .version_select at 0x7f7d2425d040>, body: {"keypair": {"name": "tempest-keypair-1010548059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjYYwciBtRwdy0fgw0do/BUpH7ELwkXAAKLxj8v2UZ8SGsceIGvGSRhlv4zBEWOmJayuuBQKTcTLWLS3QGsyunSpAWtXKph8n9383vuRicSi3LXLCqYuUYwg/0ng9qMcg=="}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:37.675755 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-25c265bb-deba-4778-b5ac-66812cf8a5b7 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Getting quotas for project 643240773a5840d3af2622469d696beb. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:42:37.679695 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-25c265bb-deba-4778-b5ac-66812cf8a5b7 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Getting quotas for user 651659e941044454985b2f866b791b07 and project 643240773a5840d3af2622469d696beb. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:42:37.704131 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-25c265bb-deba-4778-b5ac-66812cf8a5b7 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048752 Aug 08 13:42:37.704738 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 363/707] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 13:42:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:39.138427 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1279589375", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f99375f-7b41-4df8-ae3e-5e6aad84dbaf"}], "security_groups": [{"name": "tempest-securitygroup--1664577430"}], "key_name": "tempest-keypair-1010548059", "user_data": "}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:39.278030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] validate_networks() for [('7f99375f-7b41-4df8-ae3e-5e6aad84dbaf', None, None, None, None, None)] {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:42:39.775894 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:42:39.776317 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:42:39.776787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:42:39.777197 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:42:39.777605 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:42:39.787553 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:39.788046 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:39.788478 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:39.789209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:39.789684 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:39.790103 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:39.810381 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Getting quotas for project 643240773a5840d3af2622469d696beb. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:42:39.814843 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Getting quotas for user 651659e941044454985b2f866b791b07 and project 643240773a5840d3af2622469d696beb. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:42:39.827033 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:42:39.829516 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:42:39.877763 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0fb831a8-1218-4fd1-821b-ef4ab80b343f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.749311 Aug 08 13:42:39.878412 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 345/708] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:42:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:42:39.890228 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-09cda832-c928-4936-9030-854cef0f7f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:39.890882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-09cda832-c928-4936-9030-854cef0f7f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:39.950311 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-09cda832-c928-4936-9030-854cef0f7f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:39.957353 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-09cda832-c928-4936-9030-854cef0f7f1a tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1238 microversion: 2.1 time: 0.071610 Aug 08 13:42:39.957947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 364/709] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:39 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:40.979114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e6ca4fd2-7dab-4183-98fa-4746454da1e4 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:40.979744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e6ca4fd2-7dab-4183-98fa-4746454da1e4 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:40.986683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ca4fd2-7dab-4183-98fa-4746454da1e4 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:40.987202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ca4fd2-7dab-4183-98fa-4746454da1e4 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:40.987633 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ca4fd2-7dab-4183-98fa-4746454da1e4 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:40.988340 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ca4fd2-7dab-4183-98fa-4746454da1e4 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:40.988788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ca4fd2-7dab-4183-98fa-4746454da1e4 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:40.989204 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e6ca4fd2-7dab-4183-98fa-4746454da1e4 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:41.057178 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e6ca4fd2-7dab-4183-98fa-4746454da1e4 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:41.065817 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e6ca4fd2-7dab-4183-98fa-4746454da1e4 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1290 microversion: 2.1 time: 0.091559 Aug 08 13:42:41.066389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 346/710] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:40 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:42.091290 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4f05c904-8b17-4adf-b52a-756df60f972c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:42.091895 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4f05c904-8b17-4adf-b52a-756df60f972c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:42.098392 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f05c904-8b17-4adf-b52a-756df60f972c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:42.098883 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f05c904-8b17-4adf-b52a-756df60f972c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:42.099353 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f05c904-8b17-4adf-b52a-756df60f972c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:42.100471 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f05c904-8b17-4adf-b52a-756df60f972c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:42.100925 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f05c904-8b17-4adf-b52a-756df60f972c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:42.101351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4f05c904-8b17-4adf-b52a-756df60f972c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:42.254748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4f05c904-8b17-4adf-b52a-756df60f972c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:42.263694 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4f05c904-8b17-4adf-b52a-756df60f972c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1364 microversion: 2.1 time: 0.178998 Aug 08 13:42:42.264416 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 365/711] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:42 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:42.658033 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-52804442-5404-4d77-a08e-1d0ba252d989 req-117605de-a1ff-443d-9919-40ce5ec87153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfd4416-ef05-480e-991b-2f18443ac75b", "tag": "82fb36fd-bb54-407c-bbc3-960cd251607d"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:42.668124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-52804442-5404-4d77-a08e-1d0ba252d989 req-117605de-a1ff-443d-9919-40ce5ec87153 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:42.668671 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-52804442-5404-4d77-a08e-1d0ba252d989 req-117605de-a1ff-443d-9919-40ce5ec87153 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:42.669186 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-52804442-5404-4d77-a08e-1d0ba252d989 req-117605de-a1ff-443d-9919-40ce5ec87153 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:42.680996 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-52804442-5404-4d77-a08e-1d0ba252d989 req-117605de-a1ff-443d-9919-40ce5ec87153 service nova] Creating event network-changed:82fb36fd-bb54-407c-bbc3-960cd251607d for instance 9dfd4416-ef05-480e-991b-2f18443ac75b on hv-cinder-85199 Aug 08 13:42:42.685866 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-52804442-5404-4d77-a08e-1d0ba252d989 req-117605de-a1ff-443d-9919-40ce5ec87153 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031882 Aug 08 13:42:42.686501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 347/712] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:43.285871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d55e1f28-396d-49d4-9716-dd1b36f640ae tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:43.286476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d55e1f28-396d-49d4-9716-dd1b36f640ae tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:43.292942 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d55e1f28-396d-49d4-9716-dd1b36f640ae tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:43.293409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d55e1f28-396d-49d4-9716-dd1b36f640ae tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:43.293871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d55e1f28-396d-49d4-9716-dd1b36f640ae tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:43.294562 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d55e1f28-396d-49d4-9716-dd1b36f640ae tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:43.295121 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d55e1f28-396d-49d4-9716-dd1b36f640ae tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:43.295470 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d55e1f28-396d-49d4-9716-dd1b36f640ae tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:43.448944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d55e1f28-396d-49d4-9716-dd1b36f640ae tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:43.457346 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d55e1f28-396d-49d4-9716-dd1b36f640ae tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1364 microversion: 2.1 time: 0.176078 Aug 08 13:42:43.458009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 366/713] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:43 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:44.482512 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8e873dbb-f8d4-4278-8593-90016f8cbb97 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:44.483746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8e873dbb-f8d4-4278-8593-90016f8cbb97 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:44.493005 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e873dbb-f8d4-4278-8593-90016f8cbb97 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:44.493701 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e873dbb-f8d4-4278-8593-90016f8cbb97 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:44.494234 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e873dbb-f8d4-4278-8593-90016f8cbb97 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:44.495514 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e873dbb-f8d4-4278-8593-90016f8cbb97 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:44.499231 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e873dbb-f8d4-4278-8593-90016f8cbb97 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:44.499671 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e873dbb-f8d4-4278-8593-90016f8cbb97 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:44.889426 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8e873dbb-f8d4-4278-8593-90016f8cbb97 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:44.897459 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8e873dbb-f8d4-4278-8593-90016f8cbb97 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1364 microversion: 2.1 time: 0.421227 Aug 08 13:42:44.898016 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 348/714] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:44 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1364 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:45.917901 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-91901e73-9818-43d5-94e5-3ae9f0455f65 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:45.919220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-91901e73-9818-43d5-94e5-3ae9f0455f65 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:45.928230 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-91901e73-9818-43d5-94e5-3ae9f0455f65 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:45.928759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-91901e73-9818-43d5-94e5-3ae9f0455f65 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:45.929432 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-91901e73-9818-43d5-94e5-3ae9f0455f65 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:45.930041 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-91901e73-9818-43d5-94e5-3ae9f0455f65 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:45.930554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-91901e73-9818-43d5-94e5-3ae9f0455f65 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:45.931009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-91901e73-9818-43d5-94e5-3ae9f0455f65 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:46.090253 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-91901e73-9818-43d5-94e5-3ae9f0455f65 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:46.102350 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-91901e73-9818-43d5-94e5-3ae9f0455f65 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1364 microversion: 2.1 time: 0.188226 Aug 08 13:42:46.102979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 367/715] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:45 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:47.123542 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5bd4f139-5440-4588-a075-975c76b843de tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:47.124140 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5bd4f139-5440-4588-a075-975c76b843de tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:47.130620 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5bd4f139-5440-4588-a075-975c76b843de tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:47.131106 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5bd4f139-5440-4588-a075-975c76b843de tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:47.131561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5bd4f139-5440-4588-a075-975c76b843de tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:47.132249 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5bd4f139-5440-4588-a075-975c76b843de tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:47.132693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5bd4f139-5440-4588-a075-975c76b843de tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:47.133114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5bd4f139-5440-4588-a075-975c76b843de tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:47.135962 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:47.280483 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5bd4f139-5440-4588-a075-975c76b843de tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:47.288933 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5bd4f139-5440-4588-a075-975c76b843de tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1364 microversion: 2.1 time: 0.169160 Aug 08 13:42:47.290444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 349/716] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:47 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:48.311944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-722f1752-63cf-4f6b-92ec-0c181368f87c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:48.312793 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-722f1752-63cf-4f6b-92ec-0c181368f87c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:48.322557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-722f1752-63cf-4f6b-92ec-0c181368f87c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:48.323271 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-722f1752-63cf-4f6b-92ec-0c181368f87c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:48.323913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-722f1752-63cf-4f6b-92ec-0c181368f87c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:48.324838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-722f1752-63cf-4f6b-92ec-0c181368f87c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:48.325539 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-722f1752-63cf-4f6b-92ec-0c181368f87c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:48.326096 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-722f1752-63cf-4f6b-92ec-0c181368f87c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:48.468501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-722f1752-63cf-4f6b-92ec-0c181368f87c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:48.476645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-722f1752-63cf-4f6b-92ec-0c181368f87c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1364 microversion: 2.1 time: 0.169345 Aug 08 13:42:48.477131 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 368/717] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:48 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:42:49.379335 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-b5424aeb-2441-4959-abae-431bc396170b req-4f1282d9-6596-4536-bf48-9bffa8e898c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfd4416-ef05-480e-991b-2f18443ac75b", "name": "network-vif-plugged", "status": "completed", "tag": "82fb36fd-bb54-407c-bbc3-960cd251607d"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:49.394604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-b5424aeb-2441-4959-abae-431bc396170b req-4f1282d9-6596-4536-bf48-9bffa8e898c6 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:49.395419 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-b5424aeb-2441-4959-abae-431bc396170b req-4f1282d9-6596-4536-bf48-9bffa8e898c6 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:49.396186 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-b5424aeb-2441-4959-abae-431bc396170b req-4f1282d9-6596-4536-bf48-9bffa8e898c6 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:49.409401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-b5424aeb-2441-4959-abae-431bc396170b req-4f1282d9-6596-4536-bf48-9bffa8e898c6 service nova] Creating event network-vif-plugged:82fb36fd-bb54-407c-bbc3-960cd251607d for instance 9dfd4416-ef05-480e-991b-2f18443ac75b on hv-cinder-85199 Aug 08 13:42:49.414613 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-b5424aeb-2441-4959-abae-431bc396170b req-4f1282d9-6596-4536-bf48-9bffa8e898c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039088 Aug 08 13:42:49.415351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 350/718] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:49.497597 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4d0a4223-2a8a-437e-832a-f2511f204464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:49.498194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4d0a4223-2a8a-437e-832a-f2511f204464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:49.505039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4d0a4223-2a8a-437e-832a-f2511f204464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:49.505772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4d0a4223-2a8a-437e-832a-f2511f204464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:49.506398 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4d0a4223-2a8a-437e-832a-f2511f204464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:49.507349 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4d0a4223-2a8a-437e-832a-f2511f204464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:49.507839 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4d0a4223-2a8a-437e-832a-f2511f204464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:49.508484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4d0a4223-2a8a-437e-832a-f2511f204464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:49.710193 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4d0a4223-2a8a-437e-832a-f2511f204464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:49.720771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4d0a4223-2a8a-437e-832a-f2511f204464 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1364 microversion: 2.1 time: 0.227040 Aug 08 13:42:49.721357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 369/719] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:49 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:50.739615 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:50.740451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:50.746253 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1418db87-1bb8-4680-87a6-d7102c8e5c18 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:50.747000 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1418db87-1bb8-4680-87a6-d7102c8e5c18 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:50.754429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1418db87-1bb8-4680-87a6-d7102c8e5c18 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:50.754911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1418db87-1bb8-4680-87a6-d7102c8e5c18 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:50.755468 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1418db87-1bb8-4680-87a6-d7102c8e5c18 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:50.756167 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1418db87-1bb8-4680-87a6-d7102c8e5c18 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:50.756614 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1418db87-1bb8-4680-87a6-d7102c8e5c18 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:50.757045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1418db87-1bb8-4680-87a6-d7102c8e5c18 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:50.892618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1418db87-1bb8-4680-87a6-d7102c8e5c18 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:50.900323 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1418db87-1bb8-4680-87a6-d7102c8e5c18 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1364 microversion: 2.1 time: 0.161676 Aug 08 13:42:50.900883 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 351/720] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:50 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:51.926723 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-35a3e029-afbb-4ed8-a23f-5d3cc680dc8f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:51.927882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-35a3e029-afbb-4ed8-a23f-5d3cc680dc8f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:51.931306 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:42:51.939886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35a3e029-afbb-4ed8-a23f-5d3cc680dc8f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:51.940384 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35a3e029-afbb-4ed8-a23f-5d3cc680dc8f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:51.940854 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35a3e029-afbb-4ed8-a23f-5d3cc680dc8f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:51.941584 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35a3e029-afbb-4ed8-a23f-5d3cc680dc8f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:51.942034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35a3e029-afbb-4ed8-a23f-5d3cc680dc8f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:51.942460 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35a3e029-afbb-4ed8-a23f-5d3cc680dc8f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:52.085009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-35a3e029-afbb-4ed8-a23f-5d3cc680dc8f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:42:52.092751 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-35a3e029-afbb-4ed8-a23f-5d3cc680dc8f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1549 microversion: 2.1 time: 0.173870 Aug 08 13:42:52.093333 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 370/721] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:42:51 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:42:52.113954 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-02ab2497-b1a1-4be5-b67c-971cda73c903 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:42:52.115055 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-02ab2497-b1a1-4be5-b67c-971cda73c903 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:42:52.122959 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02ab2497-b1a1-4be5-b67c-971cda73c903 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:52.123470 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02ab2497-b1a1-4be5-b67c-971cda73c903 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:52.124012 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02ab2497-b1a1-4be5-b67c-971cda73c903 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:52.124880 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02ab2497-b1a1-4be5-b67c-971cda73c903 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:52.125587 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02ab2497-b1a1-4be5-b67c-971cda73c903 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:52.126177 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02ab2497-b1a1-4be5-b67c-971cda73c903 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:52.211575 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-02ab2497-b1a1-4be5-b67c-971cda73c903 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101422 Aug 08 13:42:52.212186 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 352/722] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 13:42:52 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:42:53.589644 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-bcb77657-61bb-4fa6-a109-1eb87b6adb8f req-df5ab532-69da-4631-86c7-6911d7cbd55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfd4416-ef05-480e-991b-2f18443ac75b", "tag": "82fb36fd-bb54-407c-bbc3-960cd251607d"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:42:53.600342 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-bcb77657-61bb-4fa6-a109-1eb87b6adb8f req-df5ab532-69da-4631-86c7-6911d7cbd55f service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:42:53.601577 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-bcb77657-61bb-4fa6-a109-1eb87b6adb8f req-df5ab532-69da-4631-86c7-6911d7cbd55f service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:42:53.601577 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-bcb77657-61bb-4fa6-a109-1eb87b6adb8f req-df5ab532-69da-4631-86c7-6911d7cbd55f service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:42:53.620226 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-bcb77657-61bb-4fa6-a109-1eb87b6adb8f req-df5ab532-69da-4631-86c7-6911d7cbd55f service nova] Creating event network-changed:82fb36fd-bb54-407c-bbc3-960cd251607d for instance 9dfd4416-ef05-480e-991b-2f18443ac75b on hv-cinder-85199 Aug 08 13:42:53.641045 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-bcb77657-61bb-4fa6-a109-1eb87b6adb8f req-df5ab532-69da-4631-86c7-6911d7cbd55f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054974 Aug 08 13:42:53.641655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 371/723] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:17.436434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:17.437195 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=17 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:17.442572 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2264acbb-779d-4966-b170-d9e25db94f9d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:17.443581 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2264acbb-779d-4966-b170-d9e25db94f9d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:17.453233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2264acbb-779d-4966-b170-d9e25db94f9d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:17.453899 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2264acbb-779d-4966-b170-d9e25db94f9d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:17.454514 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2264acbb-779d-4966-b170-d9e25db94f9d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:17.455737 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2264acbb-779d-4966-b170-d9e25db94f9d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:17.456335 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2264acbb-779d-4966-b170-d9e25db94f9d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:17.456838 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2264acbb-779d-4966-b170-d9e25db94f9d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:17.484424 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2264acbb-779d-4966-b170-d9e25db94f9d tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/ips" status: 200 len: 148 microversion: 2.1 time: 0.050258 Aug 08 13:43:17.484988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 353/724] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 13:43:17 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/ips => generated 148 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:19.906205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-54001882-9996-42aa-b9dc-ae053320e567 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af308837-3f03-4ece-94bc-9bce69178e6d"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:19.908719 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-54001882-9996-42aa-b9dc-ae053320e567 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:19.911053 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:19.912337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=52 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:19.919397 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-54001882-9996-42aa-b9dc-ae053320e567 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:19.919884 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-54001882-9996-42aa-b9dc-ae053320e567 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:19.920318 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-54001882-9996-42aa-b9dc-ae053320e567 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:19.921023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-54001882-9996-42aa-b9dc-ae053320e567 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:19.921472 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-54001882-9996-42aa-b9dc-ae053320e567 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:19.921898 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-54001882-9996-42aa-b9dc-ae053320e567 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:20.216530 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-54001882-9996-42aa-b9dc-ae053320e567 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314543 Aug 08 13:43:20.220189 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 372/725] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:43:19 2022] POST /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:28.901343 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af308837-3f03-4ece-94bc-9bce69178e6d"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:28.903738 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:28.906302 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:28.906955 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:28.914256 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:28.914914 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:28.915354 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:28.916067 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:28.916514 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:28.916937 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:29.015057 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Invalid volume: volume af308837-3f03-4ece-94bc-9bce69178e6d is already attached to instances: 16e355ee-03af-44f5-b661-405530019c73 Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: POST /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments HTTP/1.1 Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 74 Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:43:29.016722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {"volumeAttachment": {"volumeId": "af308837-3f03-4ece-94bc-9bce69178e6d"}} Aug 08 13:43:29.018389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Invalid volume: volume af308837-3f03-4ece-94bc-9bce69178e6d is already attached to instances: 16e355ee-03af-44f5-b661-405530019c73 Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'server_id': '16e355ee-03af-44f5-b661-405530019c73', 'body': {'volumeAttachment': {'volumeId': 'af308837-3f03-4ece-94bc-9bce69178e6d'}}} Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume af308837-3f03-4ece-94bc-9bce69178e6d is already attached to instances: 16e355ee-03af-44f5-b661-405530019c73 Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:43:29.022877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume af308837-3f03-4ece-94bc-9bce69178e6d is already attached to instances: 16e355ee-03af-44f5-b661-405530019c73 Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:43:29.024485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:43:29.026442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:43:29.026442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:43:29.026442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:43:29.026442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume af308837-3f03-4ece-94bc-9bce69178e6d is already attached to instances: 16e355ee-03af-44f5-b661-405530019c73 Aug 08 13:43:29.026442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:43:29.026442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 400 to user: Invalid volume: volume af308837-3f03-4ece-94bc-9bce69178e6d is already attached to instances: 16e355ee-03af-44f5-b661-405530019c73 {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:43:29.026442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-065c6ec0-79d8-4b32-9b0e-0448de0fcc53 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121738 Aug 08 13:43:29.026442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 354/726] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:43:28 2022] POST /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 13:43:29.088093 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3de18832-e245-4d9f-9fcc-f6c372e7e56c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:29.088718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3de18832-e245-4d9f-9fcc-f6c372e7e56c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:29.099417 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3de18832-e245-4d9f-9fcc-f6c372e7e56c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:29.100725 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3de18832-e245-4d9f-9fcc-f6c372e7e56c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:29.101634 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3de18832-e245-4d9f-9fcc-f6c372e7e56c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:29.102890 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3de18832-e245-4d9f-9fcc-f6c372e7e56c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:29.103687 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3de18832-e245-4d9f-9fcc-f6c372e7e56c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:29.104401 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3de18832-e245-4d9f-9fcc-f6c372e7e56c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:29.209434 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-3de18832-e245-4d9f-9fcc-f6c372e7e56c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lazy-loading 'services' on Instance uuid 16e355ee-03af-44f5-b661-405530019c73 {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:43:29.295044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3de18832-e245-4d9f-9fcc-f6c372e7e56c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments/af308837-3f03-4ece-94bc-9bce69178e6d" status: 202 len: 0 microversion: 2.1 time: 0.211706 Aug 08 13:43:29.295747 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 373/727] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:43:29 2022] DELETE /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments/af308837-3f03-4ece-94bc-9bce69178e6d => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:43:29.305413 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-79fba6b0-248c-429c-a0db-49435e30a525 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:29.307720 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-79fba6b0-248c-429c-a0db-49435e30a525 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:29.315171 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79fba6b0-248c-429c-a0db-49435e30a525 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:29.315693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79fba6b0-248c-429c-a0db-49435e30a525 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:29.316188 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79fba6b0-248c-429c-a0db-49435e30a525 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:29.317128 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79fba6b0-248c-429c-a0db-49435e30a525 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:29.317750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79fba6b0-248c-429c-a0db-49435e30a525 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:29.318174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-79fba6b0-248c-429c-a0db-49435e30a525 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:29.350117 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-79fba6b0-248c-429c-a0db-49435e30a525 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048779 Aug 08 13:43:29.350690 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 355/728] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:43:29 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:30.363960 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8228919a-4d25-43cf-8a0e-52a3c7c5e0eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:30.366495 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8228919a-4d25-43cf-8a0e-52a3c7c5e0eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:30.373011 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8228919a-4d25-43cf-8a0e-52a3c7c5e0eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:30.373495 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8228919a-4d25-43cf-8a0e-52a3c7c5e0eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:30.373915 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8228919a-4d25-43cf-8a0e-52a3c7c5e0eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:30.374608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8228919a-4d25-43cf-8a0e-52a3c7c5e0eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:30.375048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8228919a-4d25-43cf-8a0e-52a3c7c5e0eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:30.375485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8228919a-4d25-43cf-8a0e-52a3c7c5e0eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:30.406688 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8228919a-4d25-43cf-8a0e-52a3c7c5e0eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047688 Aug 08 13:43:30.407261 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 374/729] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:43:30 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 13:43:30.481549 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-47507d08-bc03-48b1-8b3e-838c5c7681a9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:30.482122 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-47507d08-bc03-48b1-8b3e-838c5c7681a9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:30.488810 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47507d08-bc03-48b1-8b3e-838c5c7681a9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:30.489290 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47507d08-bc03-48b1-8b3e-838c5c7681a9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:30.489718 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47507d08-bc03-48b1-8b3e-838c5c7681a9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:30.490413 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47507d08-bc03-48b1-8b3e-838c5c7681a9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:30.490898 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47507d08-bc03-48b1-8b3e-838c5c7681a9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:30.491379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-47507d08-bc03-48b1-8b3e-838c5c7681a9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:30.517374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-47507d08-bc03-48b1-8b3e-838c5c7681a9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:43:30.602989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-47507d08-bc03-48b1-8b3e-838c5c7681a9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 204 len: 0 microversion: 2.1 time: 0.125042 Aug 08 13:43:30.604046 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 356/730] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:43:30 2022] DELETE /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:43:30.613738 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-89bbec7a-3d10-4ebc-b0f9-d85adbce6c56 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:30.614337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-89bbec7a-3d10-4ebc-b0f9-d85adbce6c56 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:30.620397 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-89bbec7a-3d10-4ebc-b0f9-d85adbce6c56 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:30.620868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-89bbec7a-3d10-4ebc-b0f9-d85adbce6c56 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:30.621294 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-89bbec7a-3d10-4ebc-b0f9-d85adbce6c56 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:30.621973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-89bbec7a-3d10-4ebc-b0f9-d85adbce6c56 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:30.622386 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-89bbec7a-3d10-4ebc-b0f9-d85adbce6c56 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:30.622797 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-89bbec7a-3d10-4ebc-b0f9-d85adbce6c56 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:30.761687 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-89bbec7a-3d10-4ebc-b0f9-d85adbce6c56 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:30.773253 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-89bbec7a-3d10-4ebc-b0f9-d85adbce6c56 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1679 microversion: 2.1 time: 0.163648 Aug 08 13:43:30.773913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 375/731] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:30 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:43:31.795221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-68f029c3-5db2-4f58-ab59-1149f472d96c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:31.796058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-68f029c3-5db2-4f58-ab59-1149f472d96c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:31.802629 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68f029c3-5db2-4f58-ab59-1149f472d96c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:31.803139 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68f029c3-5db2-4f58-ab59-1149f472d96c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:31.803607 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68f029c3-5db2-4f58-ab59-1149f472d96c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:31.804296 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68f029c3-5db2-4f58-ab59-1149f472d96c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:31.804835 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68f029c3-5db2-4f58-ab59-1149f472d96c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:31.805259 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-68f029c3-5db2-4f58-ab59-1149f472d96c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:31.953120 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-68f029c3-5db2-4f58-ab59-1149f472d96c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:31.962532 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-68f029c3-5db2-4f58-ab59-1149f472d96c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1679 microversion: 2.1 time: 0.171432 Aug 08 13:43:31.963335 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 357/732] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:31 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:32.987681 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ff1556c9-0cb1-4923-b2a8-cf650280c507 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:32.988335 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ff1556c9-0cb1-4923-b2a8-cf650280c507 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:32.996257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff1556c9-0cb1-4923-b2a8-cf650280c507 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:32.996978 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff1556c9-0cb1-4923-b2a8-cf650280c507 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:32.997606 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff1556c9-0cb1-4923-b2a8-cf650280c507 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:32.998484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff1556c9-0cb1-4923-b2a8-cf650280c507 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:32.999124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff1556c9-0cb1-4923-b2a8-cf650280c507 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:32.999545 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff1556c9-0cb1-4923-b2a8-cf650280c507 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:33.181640 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ff1556c9-0cb1-4923-b2a8-cf650280c507 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:33.190179 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ff1556c9-0cb1-4923-b2a8-cf650280c507 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1679 microversion: 2.1 time: 0.206595 Aug 08 13:43:33.191122 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 376/733] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:32 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:33.395611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-2cca5517-17df-4ecb-9d62-d57fe3059835 req-10610a1e-98d8-4698-afd4-940ec0f5a1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e355ee-03af-44f5-b661-405530019c73", "name": "network-vif-deleted", "tag": "2f0f1b91-5027-4893-908c-797a761e4624"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:33.407261 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-2cca5517-17df-4ecb-9d62-d57fe3059835 req-10610a1e-98d8-4698-afd4-940ec0f5a1f9 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:33.407618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-2cca5517-17df-4ecb-9d62-d57fe3059835 req-10610a1e-98d8-4698-afd4-940ec0f5a1f9 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:33.408251 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-2cca5517-17df-4ecb-9d62-d57fe3059835 req-10610a1e-98d8-4698-afd4-940ec0f5a1f9 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:33.420785 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-2cca5517-17df-4ecb-9d62-d57fe3059835 req-10610a1e-98d8-4698-afd4-940ec0f5a1f9 service nova] Creating event network-vif-deleted:2f0f1b91-5027-4893-908c-797a761e4624 for instance 16e355ee-03af-44f5-b661-405530019c73 on hv-cinder-85199 Aug 08 13:43:33.426222 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-2cca5517-17df-4ecb-9d62-d57fe3059835 req-10610a1e-98d8-4698-afd4-940ec0f5a1f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035189 Aug 08 13:43:33.427699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 358/734] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:34.212615 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:34.216194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:34.225255 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:34.226488 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:34.227119 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:34.227901 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:34.228444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:34.228955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:34.268030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:34.268882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:34.269376 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:34.269892 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lazy-loading 'fault' on Instance uuid 16e355ee-03af-44f5-b661-405530019c73 {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:43:34.318360 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:34.326279 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3c7b6d42-bc40-4f41-9ce5-b5981bb39d00 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 200 len: 1331 microversion: 2.1 time: 0.117633 Aug 08 13:43:34.326846 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 377/735] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:34 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:35.351233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:35.352444 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:35.361565 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:35.362300 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:35.362960 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:35.364046 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:35.364741 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:35.365378 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:35.386363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 HTTP/1.1 Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:43:35.388298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:43:35.389643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '16e355ee-03af-44f5-b661-405530019c73'} Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:43:35.390475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:43:35.391819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:43:35.393138 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:43:35.393138 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0650cb27-cce2-41e2-ac04-ef038118d7eb tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 404 len: 111 microversion: 2.1 time: 0.045431 Aug 08 13:43:35.393138 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 359/736] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:35 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:43:35.401763 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-29cecd10-e723-463e-902d-4d919cd52ac9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '.version_select at 0x7f7d242bc3a0>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:35.426733 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-29cecd10-e723-463e-902d-4d919cd52ac9 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513619601" status: 202 len: 0 microversion: 2.1 time: 0.029516 Aug 08 13:43:35.427374 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 378/737] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Aug 8 13:43:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513619601 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 13:43:36.079570 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7e88ac28-14a5-4bc4-b97c-e21494ec6fe5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: .version_select at 0x7f7d241628b0>, body: {"keypair": {"name": "tempest-keypair-217008974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNARxYxwiD/psqPdo8GESZN6kHunJNQlzaXFLl8T1W+ZDN2rmsne07h1Ib8GTfozTlpM1D7Le+hKqlr9vJvviZWIsSfyUvcgc089ck2otx6JQUNQBaaer7XGxWtmFXatQ=="}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:36.096560 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-7e88ac28-14a5-4bc4-b97c-e21494ec6fe5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:43:36.100967 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-7e88ac28-14a5-4bc4-b97c-e21494ec6fe5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for user fce6a7d7dbc94adeb0b03bae34e335a0 and project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:43:36.124720 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7e88ac28-14a5-4bc4-b97c-e21494ec6fe5 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050389 Aug 08 13:43:36.125336 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 360/738] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 13:43:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:37.556704 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1866537266", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96099fae-9cab-447b-98a0-f55f4a95af9e"}], "security_groups": [{"name": "tempest-securitygroup--321319004"}], "key_name": "tempest-keypair-217008974", "user_data": "}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:37.661352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] validate_networks() for [('96099fae-9cab-447b-98a0-f55f4a95af9e', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:43:38.077492 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:43:38.077903 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:43:38.078369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:43:38.078767 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:43:38.079269 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:43:38.091095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:38.091806 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:38.092449 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:38.093467 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:38.093917 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:38.094621 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:38.114557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:43:38.118724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Getting quotas for user fce6a7d7dbc94adeb0b03bae34e335a0 and project 4293ff5f2cad4c399d03a89f4bc627f5. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:43:38.132239 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:43:38.134571 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:43:38.182719 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d4df3eb5-c44a-41f1-aede-b50a2820e852 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.630872 Aug 08 13:43:38.183631 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 379/739] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:43:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:43:38.194884 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a33fa3c6-21d5-4b5b-9bd2-5f6bcd6c4154 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:38.195608 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a33fa3c6-21d5-4b5b-9bd2-5f6bcd6c4154 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:38.256867 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a33fa3c6-21d5-4b5b-9bd2-5f6bcd6c4154 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:38.265202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a33fa3c6-21d5-4b5b-9bd2-5f6bcd6c4154 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1241 microversion: 2.1 time: 0.074575 Aug 08 13:43:38.265783 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 361/740] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:38 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:43:39.289365 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-931157c1-c679-4c00-9a4c-f6afb4cb831f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:39.290185 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-931157c1-c679-4c00-9a4c-f6afb4cb831f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:39.298611 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-931157c1-c679-4c00-9a4c-f6afb4cb831f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:39.299354 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-931157c1-c679-4c00-9a4c-f6afb4cb831f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:39.299781 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-931157c1-c679-4c00-9a4c-f6afb4cb831f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:39.300484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-931157c1-c679-4c00-9a4c-f6afb4cb831f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:39.300932 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-931157c1-c679-4c00-9a4c-f6afb4cb831f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:39.301350 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-931157c1-c679-4c00-9a4c-f6afb4cb831f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:39.373881 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-931157c1-c679-4c00-9a4c-f6afb4cb831f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:39.385140 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-931157c1-c679-4c00-9a4c-f6afb4cb831f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1301 microversion: 2.1 time: 0.101499 Aug 08 13:43:39.386030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 380/741] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:39 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:40.407146 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3ecd3898-8dac-4d90-96ee-b1a0ebc2b72c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:40.409180 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3ecd3898-8dac-4d90-96ee-b1a0ebc2b72c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:40.416801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ecd3898-8dac-4d90-96ee-b1a0ebc2b72c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:40.417283 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ecd3898-8dac-4d90-96ee-b1a0ebc2b72c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:40.417707 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ecd3898-8dac-4d90-96ee-b1a0ebc2b72c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:40.418404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ecd3898-8dac-4d90-96ee-b1a0ebc2b72c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:40.418842 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ecd3898-8dac-4d90-96ee-b1a0ebc2b72c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:40.419284 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3ecd3898-8dac-4d90-96ee-b1a0ebc2b72c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:40.557184 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3ecd3898-8dac-4d90-96ee-b1a0ebc2b72c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:40.566933 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3ecd3898-8dac-4d90-96ee-b1a0ebc2b72c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.161789 Aug 08 13:43:40.566933 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 362/742] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:40 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:41.232618 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-40bd5240-e465-43ea-95f0-bef12cdf29ea req-7754da48-0913-4343-973b-6f3d7a9df3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0", "tag": "d4f999a9-9136-4564-a976-1c55da0fc8e7"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:41.244313 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-40bd5240-e465-43ea-95f0-bef12cdf29ea req-7754da48-0913-4343-973b-6f3d7a9df3a6 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:41.245238 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-40bd5240-e465-43ea-95f0-bef12cdf29ea req-7754da48-0913-4343-973b-6f3d7a9df3a6 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:41.245967 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-40bd5240-e465-43ea-95f0-bef12cdf29ea req-7754da48-0913-4343-973b-6f3d7a9df3a6 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:41.259772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-40bd5240-e465-43ea-95f0-bef12cdf29ea req-7754da48-0913-4343-973b-6f3d7a9df3a6 service nova] Creating event network-changed:d4f999a9-9136-4564-a976-1c55da0fc8e7 for instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 on hv-cinder-85199 Aug 08 13:43:41.266142 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-40bd5240-e465-43ea-95f0-bef12cdf29ea req-7754da48-0913-4343-973b-6f3d7a9df3a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037240 Aug 08 13:43:41.267482 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 381/743] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:41.587661 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-02f6db2a-ca4e-40b7-8f97-851ebac52ff3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:41.588281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-02f6db2a-ca4e-40b7-8f97-851ebac52ff3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:41.595275 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02f6db2a-ca4e-40b7-8f97-851ebac52ff3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:41.595822 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02f6db2a-ca4e-40b7-8f97-851ebac52ff3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:41.596535 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02f6db2a-ca4e-40b7-8f97-851ebac52ff3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:41.597713 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02f6db2a-ca4e-40b7-8f97-851ebac52ff3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:41.598165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02f6db2a-ca4e-40b7-8f97-851ebac52ff3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:41.598745 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-02f6db2a-ca4e-40b7-8f97-851ebac52ff3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:41.753621 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-02f6db2a-ca4e-40b7-8f97-851ebac52ff3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:41.761297 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-02f6db2a-ca4e-40b7-8f97-851ebac52ff3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.177881 Aug 08 13:43:41.762202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 363/744] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:41 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:42.783194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0bc9e554-be98-4409-a911-0e64cc1da94b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:42.783880 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0bc9e554-be98-4409-a911-0e64cc1da94b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:42.790560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0bc9e554-be98-4409-a911-0e64cc1da94b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:42.791040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0bc9e554-be98-4409-a911-0e64cc1da94b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:42.791501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0bc9e554-be98-4409-a911-0e64cc1da94b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:42.792220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0bc9e554-be98-4409-a911-0e64cc1da94b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:42.792652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0bc9e554-be98-4409-a911-0e64cc1da94b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:42.793054 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0bc9e554-be98-4409-a911-0e64cc1da94b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:42.943568 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0bc9e554-be98-4409-a911-0e64cc1da94b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:42.951337 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0bc9e554-be98-4409-a911-0e64cc1da94b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.172839 Aug 08 13:43:42.951918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 382/745] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:42 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:43.359971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1297040261", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:43.426644 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] validate_networks() for None {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:43:43.738613 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:43:43.739024 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:43:43.739524 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:43:43.739923 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:43:43.740326 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:43:43.750214 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:43.750835 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:43.751351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:43.752221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:43.752729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:43.753188 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:43.771794 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Getting quotas for project a60666e80b524408a8f5662afe2f0868. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:43:43.776544 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Getting quotas for user 5baa03ceeedb4e31bd78256486e55330 and project a60666e80b524408a8f5662afe2f0868. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:43:43.790623 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:43:43.793285 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:43:43.842130 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1dddc1e8-6ab6-4e98-9e2b-7ef203bb6b67 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488308 Aug 08 13:43:43.843054 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 364/746] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:43:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:43:43.854976 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-41980eb4-b6ba-4a01-8028-2de3204be033 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:43.855931 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-41980eb4-b6ba-4a01-8028-2de3204be033 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:43.914962 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-41980eb4-b6ba-4a01-8028-2de3204be033 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:43.924067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-41980eb4-b6ba-4a01-8028-2de3204be033 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1215 microversion: 2.1 time: 0.072916 Aug 08 13:43:43.931142 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 383/747] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:43 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:43:43.974023 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-637be745-b329-46a8-acf0-22261e178e46 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:43.974719 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-637be745-b329-46a8-acf0-22261e178e46 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:43.982487 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-637be745-b329-46a8-acf0-22261e178e46 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:43.982952 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-637be745-b329-46a8-acf0-22261e178e46 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:43.983603 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-637be745-b329-46a8-acf0-22261e178e46 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:43.984462 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-637be745-b329-46a8-acf0-22261e178e46 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:43.984833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-637be745-b329-46a8-acf0-22261e178e46 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:43.985398 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-637be745-b329-46a8-acf0-22261e178e46 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:44.157494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-637be745-b329-46a8-acf0-22261e178e46 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:44.165533 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-637be745-b329-46a8-acf0-22261e178e46 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.196621 Aug 08 13:43:44.166123 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 365/748] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:43 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:44.946638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0238d08c-e95f-4ade-be9f-e197163918a5 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:44.947283 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0238d08c-e95f-4ade-be9f-e197163918a5 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:44.959982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0238d08c-e95f-4ade-be9f-e197163918a5 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:44.960486 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0238d08c-e95f-4ade-be9f-e197163918a5 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:44.961912 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0238d08c-e95f-4ade-be9f-e197163918a5 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:44.963039 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0238d08c-e95f-4ade-be9f-e197163918a5 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:44.963770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0238d08c-e95f-4ade-be9f-e197163918a5 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:44.964468 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0238d08c-e95f-4ade-be9f-e197163918a5 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:45.035236 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0238d08c-e95f-4ade-be9f-e197163918a5 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:45.047989 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0238d08c-e95f-4ade-be9f-e197163918a5 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1267 microversion: 2.1 time: 0.105251 Aug 08 13:43:45.048829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 384/749] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:44 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:45.186744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d68e6ff9-993f-4647-b0d0-d37cd435e2c2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:45.187453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d68e6ff9-993f-4647-b0d0-d37cd435e2c2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:45.195563 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d68e6ff9-993f-4647-b0d0-d37cd435e2c2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:45.196277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d68e6ff9-993f-4647-b0d0-d37cd435e2c2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:45.196799 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d68e6ff9-993f-4647-b0d0-d37cd435e2c2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:45.197466 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d68e6ff9-993f-4647-b0d0-d37cd435e2c2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:45.197918 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d68e6ff9-993f-4647-b0d0-d37cd435e2c2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:45.198338 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d68e6ff9-993f-4647-b0d0-d37cd435e2c2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:45.374140 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d68e6ff9-993f-4647-b0d0-d37cd435e2c2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:45.383680 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d68e6ff9-993f-4647-b0d0-d37cd435e2c2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.200712 Aug 08 13:43:45.384379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 366/750] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:45 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:46.070091 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3d8c5fa6-c785-4a9e-bc97-c9294e8bec4f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:46.071025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3d8c5fa6-c785-4a9e-bc97-c9294e8bec4f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:46.077723 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d8c5fa6-c785-4a9e-bc97-c9294e8bec4f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:46.078219 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d8c5fa6-c785-4a9e-bc97-c9294e8bec4f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:46.078659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d8c5fa6-c785-4a9e-bc97-c9294e8bec4f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:46.079411 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d8c5fa6-c785-4a9e-bc97-c9294e8bec4f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:46.079858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d8c5fa6-c785-4a9e-bc97-c9294e8bec4f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:46.080283 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3d8c5fa6-c785-4a9e-bc97-c9294e8bec4f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:46.152901 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3d8c5fa6-c785-4a9e-bc97-c9294e8bec4f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:46.161420 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3d8c5fa6-c785-4a9e-bc97-c9294e8bec4f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1273 microversion: 2.1 time: 0.095488 Aug 08 13:43:46.167256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 385/751] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:46 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:43:46.409824 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-346fc30d-1b2b-4b72-b66d-4b038dd6a188 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:46.410944 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-346fc30d-1b2b-4b72-b66d-4b038dd6a188 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:46.419352 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-346fc30d-1b2b-4b72-b66d-4b038dd6a188 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:46.419824 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-346fc30d-1b2b-4b72-b66d-4b038dd6a188 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:46.420548 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-346fc30d-1b2b-4b72-b66d-4b038dd6a188 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:46.421540 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-346fc30d-1b2b-4b72-b66d-4b038dd6a188 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:46.422252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-346fc30d-1b2b-4b72-b66d-4b038dd6a188 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:46.422729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-346fc30d-1b2b-4b72-b66d-4b038dd6a188 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:46.566767 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-346fc30d-1b2b-4b72-b66d-4b038dd6a188 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:46.575002 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-346fc30d-1b2b-4b72-b66d-4b038dd6a188 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.173133 Aug 08 13:43:46.576378 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 367/752] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:46 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:47.147292 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-e9e9fae3-6c39-4aa9-a54e-6cc0f2cf97eb req-55b50e91-66a6-4ffb-ab16-e4ef8b1844e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c27a0407-79f3-4b00-b28d-ad0ef9b25379", "tag": "7614246d-f79b-43d3-994d-970f1c960aaa"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:47.158352 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-e9e9fae3-6c39-4aa9-a54e-6cc0f2cf97eb req-55b50e91-66a6-4ffb-ab16-e4ef8b1844e1 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:47.158975 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-e9e9fae3-6c39-4aa9-a54e-6cc0f2cf97eb req-55b50e91-66a6-4ffb-ab16-e4ef8b1844e1 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:47.159502 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-e9e9fae3-6c39-4aa9-a54e-6cc0f2cf97eb req-55b50e91-66a6-4ffb-ab16-e4ef8b1844e1 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:47.173439 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-e9e9fae3-6c39-4aa9-a54e-6cc0f2cf97eb req-55b50e91-66a6-4ffb-ab16-e4ef8b1844e1 service nova] Creating event network-changed:7614246d-f79b-43d3-994d-970f1c960aaa for instance c27a0407-79f3-4b00-b28d-ad0ef9b25379 on hv-cinder-85199 Aug 08 13:43:47.180158 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-e9e9fae3-6c39-4aa9-a54e-6cc0f2cf97eb req-55b50e91-66a6-4ffb-ab16-e4ef8b1844e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037664 Aug 08 13:43:47.180921 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 386/753] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:47.191778 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-238dc617-56c9-4919-b11f-6747d4f82c84 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:47.192699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-238dc617-56c9-4919-b11f-6747d4f82c84 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:47.199500 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-238dc617-56c9-4919-b11f-6747d4f82c84 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:47.199998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-238dc617-56c9-4919-b11f-6747d4f82c84 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:47.200435 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-238dc617-56c9-4919-b11f-6747d4f82c84 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:47.201139 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-238dc617-56c9-4919-b11f-6747d4f82c84 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:47.201687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-238dc617-56c9-4919-b11f-6747d4f82c84 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:47.202011 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-238dc617-56c9-4919-b11f-6747d4f82c84 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:47.374812 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-238dc617-56c9-4919-b11f-6747d4f82c84 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:47.383334 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-238dc617-56c9-4919-b11f-6747d4f82c84 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1315 microversion: 2.1 time: 0.201974 Aug 08 13:43:47.383938 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 368/754] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:47 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:43:47.598962 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0d19018f-74fe-45d1-a20e-b8e9be45bc38 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:47.600178 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0d19018f-74fe-45d1-a20e-b8e9be45bc38 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:47.612104 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d19018f-74fe-45d1-a20e-b8e9be45bc38 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:47.613300 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d19018f-74fe-45d1-a20e-b8e9be45bc38 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:47.614313 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d19018f-74fe-45d1-a20e-b8e9be45bc38 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:47.615868 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d19018f-74fe-45d1-a20e-b8e9be45bc38 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:47.616986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d19018f-74fe-45d1-a20e-b8e9be45bc38 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:47.618023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0d19018f-74fe-45d1-a20e-b8e9be45bc38 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:47.783688 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-8d5cc0ef-4f85-478d-af1d-d5251dbfff6e req-e51d7610-0c92-4c64-8b21-5014c8f34151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0", "name": "network-vif-plugged", "status": "completed", "tag": "d4f999a9-9136-4564-a976-1c55da0fc8e7"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:47.803483 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-8d5cc0ef-4f85-478d-af1d-d5251dbfff6e req-e51d7610-0c92-4c64-8b21-5014c8f34151 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:47.804180 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-8d5cc0ef-4f85-478d-af1d-d5251dbfff6e req-e51d7610-0c92-4c64-8b21-5014c8f34151 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:47.804789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-8d5cc0ef-4f85-478d-af1d-d5251dbfff6e req-e51d7610-0c92-4c64-8b21-5014c8f34151 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:47.819416 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-8d5cc0ef-4f85-478d-af1d-d5251dbfff6e req-e51d7610-0c92-4c64-8b21-5014c8f34151 service nova] Creating event network-vif-plugged:d4f999a9-9136-4564-a976-1c55da0fc8e7 for instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 on hv-cinder-85199 Aug 08 13:43:47.825855 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-8d5cc0ef-4f85-478d-af1d-d5251dbfff6e req-e51d7610-0c92-4c64-8b21-5014c8f34151 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052421 Aug 08 13:43:47.826986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 369/755] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:47.840377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0d19018f-74fe-45d1-a20e-b8e9be45bc38 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:47.849780 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0d19018f-74fe-45d1-a20e-b8e9be45bc38 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.255751 Aug 08 13:43:47.850394 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 387/756] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:47 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:43:48.198282 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-43071632-8cd2-49d7-8cfa-04faa9648dd1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:48.199098 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-43071632-8cd2-49d7-8cfa-04faa9648dd1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:48.206695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-43071632-8cd2-49d7-8cfa-04faa9648dd1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:48.207202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-43071632-8cd2-49d7-8cfa-04faa9648dd1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:48.207646 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-43071632-8cd2-49d7-8cfa-04faa9648dd1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:48.208324 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-43071632-8cd2-49d7-8cfa-04faa9648dd1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:48.208787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-43071632-8cd2-49d7-8cfa-04faa9648dd1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:48.209190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-43071632-8cd2-49d7-8cfa-04faa9648dd1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:48.238216 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-43071632-8cd2-49d7-8cfa-04faa9648dd1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/ips" status: 200 len: 152 microversion: 2.20 time: 0.045471 Aug 08 13:43:48.238802 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 370/757] 10.222.0.33 () {60 vars in 1289 bytes} [Mon Aug 8 13:43:48 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:43:48.407884 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-66d61bcd-f80b-4ac9-ae19-2be2f05333c9 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:48.408908 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-66d61bcd-f80b-4ac9-ae19-2be2f05333c9 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:48.411175 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:48.420475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-66d61bcd-f80b-4ac9-ae19-2be2f05333c9 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:48.421780 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-66d61bcd-f80b-4ac9-ae19-2be2f05333c9 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:48.422930 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-66d61bcd-f80b-4ac9-ae19-2be2f05333c9 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:48.424456 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-66d61bcd-f80b-4ac9-ae19-2be2f05333c9 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:48.425180 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-66d61bcd-f80b-4ac9-ae19-2be2f05333c9 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:48.425997 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-66d61bcd-f80b-4ac9-ae19-2be2f05333c9 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:48.651464 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-66d61bcd-f80b-4ac9-ae19-2be2f05333c9 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:48.659716 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-66d61bcd-f80b-4ac9-ae19-2be2f05333c9 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1315 microversion: 2.1 time: 0.257558 Aug 08 13:43:48.660488 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 388/758] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:48 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:43:48.880755 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-abba2f09-bc57-4fbc-8b1a-e1324c416322 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:48.881351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-abba2f09-bc57-4fbc-8b1a-e1324c416322 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:48.889148 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-abba2f09-bc57-4fbc-8b1a-e1324c416322 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:48.889633 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-abba2f09-bc57-4fbc-8b1a-e1324c416322 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:48.890060 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-abba2f09-bc57-4fbc-8b1a-e1324c416322 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:48.890781 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-abba2f09-bc57-4fbc-8b1a-e1324c416322 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:48.891268 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-abba2f09-bc57-4fbc-8b1a-e1324c416322 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:48.891687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-abba2f09-bc57-4fbc-8b1a-e1324c416322 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:49.047886 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-abba2f09-bc57-4fbc-8b1a-e1324c416322 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:49.059318 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-abba2f09-bc57-4fbc-8b1a-e1324c416322 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.182577 Aug 08 13:43:49.059918 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 371/759] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:48 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:49.685349 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2e0bbdb1-1747-4954-ab54-92126bcc321a tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:49.686142 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2e0bbdb1-1747-4954-ab54-92126bcc321a tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:49.695539 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e0bbdb1-1747-4954-ab54-92126bcc321a tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:49.696040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e0bbdb1-1747-4954-ab54-92126bcc321a tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:49.696637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e0bbdb1-1747-4954-ab54-92126bcc321a tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:49.697357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e0bbdb1-1747-4954-ab54-92126bcc321a tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:49.697827 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e0bbdb1-1747-4954-ab54-92126bcc321a tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:49.698262 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e0bbdb1-1747-4954-ab54-92126bcc321a tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:49.865588 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2e0bbdb1-1747-4954-ab54-92126bcc321a tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:49.879604 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2e0bbdb1-1747-4954-ab54-92126bcc321a tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1315 microversion: 2.1 time: 0.200599 Aug 08 13:43:49.880560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 389/760] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:49 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:50.084090 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-cce6db90-8e48-41c8-a6d6-cbc080740f44 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:50.084844 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-cce6db90-8e48-41c8-a6d6-cbc080740f44 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:50.092810 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cce6db90-8e48-41c8-a6d6-cbc080740f44 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:50.093354 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cce6db90-8e48-41c8-a6d6-cbc080740f44 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:50.093832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cce6db90-8e48-41c8-a6d6-cbc080740f44 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:50.094592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cce6db90-8e48-41c8-a6d6-cbc080740f44 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:50.095246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cce6db90-8e48-41c8-a6d6-cbc080740f44 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:50.095797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cce6db90-8e48-41c8-a6d6-cbc080740f44 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:50.272137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-cce6db90-8e48-41c8-a6d6-cbc080740f44 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:50.289015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-cce6db90-8e48-41c8-a6d6-cbc080740f44 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.208565 Aug 08 13:43:50.299939 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 372/761] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:50 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:50.445498 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f6da6591-e125-4fa1-bb38-4baf3d9bcf25 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:50.446262 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f6da6591-e125-4fa1-bb38-4baf3d9bcf25 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:50.450361 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:50.455856 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6da6591-e125-4fa1-bb38-4baf3d9bcf25 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:50.456596 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6da6591-e125-4fa1-bb38-4baf3d9bcf25 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:50.457173 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6da6591-e125-4fa1-bb38-4baf3d9bcf25 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:50.458046 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6da6591-e125-4fa1-bb38-4baf3d9bcf25 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:50.458614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6da6591-e125-4fa1-bb38-4baf3d9bcf25 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:50.459221 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6da6591-e125-4fa1-bb38-4baf3d9bcf25 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:50.464266 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:50.494603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-f6da6591-e125-4fa1-bb38-4baf3d9bcf25 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lazy-loading 'flavor' on Instance uuid a7f5ea81-40a9-4734-8c39-c5f0a2a55bab {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:43:50.698954 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f6da6591-e125-4fa1-bb38-4baf3d9bcf25 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "POST /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/action" status: 202 len: 0 microversion: 2.20 time: 0.260837 Aug 08 13:43:50.699719 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 390/762] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Aug 8 13:43:50 2022] POST /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:43:50.708866 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:50.709672 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:50.717781 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:50.718340 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:50.718842 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:50.719907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:50.720453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:50.720927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:50.868014 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:50.872007 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:50.880134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:50.881655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:50.883153 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-217c8029-0701-44f7-9e1c-bbcb44674d7d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.178365 Aug 08 13:43:50.883756 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 373/763] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:43:50 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:43:50.905214 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a6242b3d-ee0d-4966-a422-2d1122115b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:50.906177 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a6242b3d-ee0d-4966-a422-2d1122115b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:50.917145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a6242b3d-ee0d-4966-a422-2d1122115b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:50.918040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a6242b3d-ee0d-4966-a422-2d1122115b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:50.918784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a6242b3d-ee0d-4966-a422-2d1122115b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:50.920033 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a6242b3d-ee0d-4966-a422-2d1122115b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:50.920839 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a6242b3d-ee0d-4966-a422-2d1122115b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:50.921604 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a6242b3d-ee0d-4966-a422-2d1122115b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:51.134115 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a6242b3d-ee0d-4966-a422-2d1122115b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:51.141971 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a6242b3d-ee0d-4966-a422-2d1122115b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1315 microversion: 2.1 time: 0.242106 Aug 08 13:43:51.142560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 391/764] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:50 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:51.312782 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-452033e9-98c6-48ce-a263-e25d56de252c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:51.313345 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-452033e9-98c6-48ce-a263-e25d56de252c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:51.321618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-452033e9-98c6-48ce-a263-e25d56de252c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:51.322115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-452033e9-98c6-48ce-a263-e25d56de252c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:51.322546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-452033e9-98c6-48ce-a263-e25d56de252c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:51.323316 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-452033e9-98c6-48ce-a263-e25d56de252c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:51.323808 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-452033e9-98c6-48ce-a263-e25d56de252c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:51.324211 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-452033e9-98c6-48ce-a263-e25d56de252c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:51.478931 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-452033e9-98c6-48ce-a263-e25d56de252c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:51.487180 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-452033e9-98c6-48ce-a263-e25d56de252c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.178467 Aug 08 13:43:51.488048 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 374/765] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:51 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:51.907661 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:51.908243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:51.915021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:51.915534 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:51.915967 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:51.916678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:51.917124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:51.917543 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:52.067878 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:52.076555 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:52.078052 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:52.079256 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-955e04eb-5e05-4023-80db-43ed130f7647 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.175754 Aug 08 13:43:52.079790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 392/766] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:43:51 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:43:52.164691 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b7406b26-76ff-470c-96f9-076f6275f08e tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:52.165183 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b7406b26-76ff-470c-96f9-076f6275f08e tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:52.171512 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7406b26-76ff-470c-96f9-076f6275f08e tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:52.172021 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7406b26-76ff-470c-96f9-076f6275f08e tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:52.172449 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7406b26-76ff-470c-96f9-076f6275f08e tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:52.173137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7406b26-76ff-470c-96f9-076f6275f08e tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:52.173576 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7406b26-76ff-470c-96f9-076f6275f08e tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:52.173989 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b7406b26-76ff-470c-96f9-076f6275f08e tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:52.338391 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b7406b26-76ff-470c-96f9-076f6275f08e tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:52.349021 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b7406b26-76ff-470c-96f9-076f6275f08e tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1315 microversion: 2.1 time: 0.188147 Aug 08 13:43:52.350053 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 375/767] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:52 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:52.511515 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dd76cc89-f5e3-4db7-af38-7dc9ff98006c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:52.512389 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-dd76cc89-f5e3-4db7-af38-7dc9ff98006c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:52.519470 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd76cc89-f5e3-4db7-af38-7dc9ff98006c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:52.520128 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd76cc89-f5e3-4db7-af38-7dc9ff98006c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:52.520671 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd76cc89-f5e3-4db7-af38-7dc9ff98006c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:52.521668 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd76cc89-f5e3-4db7-af38-7dc9ff98006c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:52.522517 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd76cc89-f5e3-4db7-af38-7dc9ff98006c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:52.523067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dd76cc89-f5e3-4db7-af38-7dc9ff98006c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:52.689174 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-dd76cc89-f5e3-4db7-af38-7dc9ff98006c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:52.703202 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-dd76cc89-f5e3-4db7-af38-7dc9ff98006c tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1366 microversion: 2.1 time: 0.196354 Aug 08 13:43:52.704263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 393/768] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:52 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:53.103807 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:53.104402 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:53.111053 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:53.111566 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:53.111991 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:53.112732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:53.113179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:53.113594 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:53.261769 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:53.272137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:53.273718 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:53.274970 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c7e55f1c-dc6c-4d41-80f0-55fda98edc8a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.175362 Aug 08 13:43:53.275598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 376/769] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:43:53 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:43:53.371016 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-58b0f640-0a65-480e-acbd-d59c688f9b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:53.371616 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-58b0f640-0a65-480e-acbd-d59c688f9b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:53.378796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58b0f640-0a65-480e-acbd-d59c688f9b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:53.379281 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58b0f640-0a65-480e-acbd-d59c688f9b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:53.379715 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58b0f640-0a65-480e-acbd-d59c688f9b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:53.380436 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58b0f640-0a65-480e-acbd-d59c688f9b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:53.380888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58b0f640-0a65-480e-acbd-d59c688f9b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:53.381309 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-58b0f640-0a65-480e-acbd-d59c688f9b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:53.527867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-58b0f640-0a65-480e-acbd-d59c688f9b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:53.535830 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-58b0f640-0a65-480e-acbd-d59c688f9b4d tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1315 microversion: 2.1 time: 0.168967 Aug 08 13:43:53.536424 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 394/770] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:53 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:53.738170 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f954b98b-6586-4f00-a3c1-9311e0ac77d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:53.739504 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f954b98b-6586-4f00-a3c1-9311e0ac77d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:53.748202 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-a229bad8-3d4e-4263-b82b-a2e04f84ce49 req-c92ebbe5-c486-47de-a71e-75cc0cd93475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27a0407-79f3-4b00-b28d-ad0ef9b25379", "name": "network-vif-plugged", "status": "completed", "tag": "7614246d-f79b-43d3-994d-970f1c960aaa"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:53.758326 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-a229bad8-3d4e-4263-b82b-a2e04f84ce49 req-c92ebbe5-c486-47de-a71e-75cc0cd93475 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:53.758845 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f954b98b-6586-4f00-a3c1-9311e0ac77d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:53.758991 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-a229bad8-3d4e-4263-b82b-a2e04f84ce49 req-c92ebbe5-c486-47de-a71e-75cc0cd93475 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:53.759413 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-a229bad8-3d4e-4263-b82b-a2e04f84ce49 req-c92ebbe5-c486-47de-a71e-75cc0cd93475 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:53.759888 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f954b98b-6586-4f00-a3c1-9311e0ac77d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:53.760336 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f954b98b-6586-4f00-a3c1-9311e0ac77d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:53.761127 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f954b98b-6586-4f00-a3c1-9311e0ac77d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:53.761558 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f954b98b-6586-4f00-a3c1-9311e0ac77d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:53.762182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f954b98b-6586-4f00-a3c1-9311e0ac77d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:53.762648 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:53.777525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-a229bad8-3d4e-4263-b82b-a2e04f84ce49 req-c92ebbe5-c486-47de-a71e-75cc0cd93475 service nova] Creating event network-vif-plugged:7614246d-f79b-43d3-994d-970f1c960aaa for instance c27a0407-79f3-4b00-b28d-ad0ef9b25379 on hv-cinder-85199 Aug 08 13:43:53.783772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-a229bad8-3d4e-4263-b82b-a2e04f84ce49 req-c92ebbe5-c486-47de-a71e-75cc0cd93475 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039186 Aug 08 13:43:53.785029 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=12 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:53.785320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 395/771] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:53.935489 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f954b98b-6586-4f00-a3c1-9311e0ac77d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:53.944370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f954b98b-6586-4f00-a3c1-9311e0ac77d3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1555 microversion: 2.1 time: 0.212045 Aug 08 13:43:53.944993 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 377/772] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:53 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:43:53.962625 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=8 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:53.967118 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7a8559ba-afd6-4c68-8b98-4193aa10f9c3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:53.967729 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7a8559ba-afd6-4c68-8b98-4193aa10f9c3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:53.975379 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7a8559ba-afd6-4c68-8b98-4193aa10f9c3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:53.975697 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7a8559ba-afd6-4c68-8b98-4193aa10f9c3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:53.976055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7a8559ba-afd6-4c68-8b98-4193aa10f9c3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:53.976882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7a8559ba-afd6-4c68-8b98-4193aa10f9c3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:53.977264 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7a8559ba-afd6-4c68-8b98-4193aa10f9c3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:53.977686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7a8559ba-afd6-4c68-8b98-4193aa10f9c3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:54.087430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7a8559ba-afd6-4c68-8b98-4193aa10f9c3 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125578 Aug 08 13:43:54.088180 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 396/773] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 13:43:53 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:43:54.299787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:54.300421 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:54.307672 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:54.308177 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:54.308628 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:54.309436 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:54.309895 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:54.310338 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:54.557385 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b4f76331-f79f-47de-89c5-5fdbf62cb7eb tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:54.558114 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b4f76331-f79f-47de-89c5-5fdbf62cb7eb tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:54.566127 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f76331-f79f-47de-89c5-5fdbf62cb7eb tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:54.566913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f76331-f79f-47de-89c5-5fdbf62cb7eb tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:54.567535 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f76331-f79f-47de-89c5-5fdbf62cb7eb tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:54.568363 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f76331-f79f-47de-89c5-5fdbf62cb7eb tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:54.568988 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f76331-f79f-47de-89c5-5fdbf62cb7eb tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:54.569504 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4f76331-f79f-47de-89c5-5fdbf62cb7eb tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:54.758941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:54.767775 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:54.769574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:54.770688 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3de5db7f-5558-4ade-a9a3-95e2375e1db5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.475382 Aug 08 13:43:54.771301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 378/774] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:43:54 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:43:54.884828 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b4f76331-f79f-47de-89c5-5fdbf62cb7eb tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:54.892861 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b4f76331-f79f-47de-89c5-5fdbf62cb7eb tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1315 microversion: 2.1 time: 0.340306 Aug 08 13:43:54.893528 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 397/775] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:54 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:55.554144 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-56e00665-8712-44e6-abed-a6d2796dae18 req-fe16fe35-8920-4bc3-8ea8-3981e07221bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0", "tag": "d4f999a9-9136-4564-a976-1c55da0fc8e7"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:43:55.564606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-56e00665-8712-44e6-abed-a6d2796dae18 req-fe16fe35-8920-4bc3-8ea8-3981e07221bf service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:55.565097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-56e00665-8712-44e6-abed-a6d2796dae18 req-fe16fe35-8920-4bc3-8ea8-3981e07221bf service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:55.565513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-56e00665-8712-44e6-abed-a6d2796dae18 req-fe16fe35-8920-4bc3-8ea8-3981e07221bf service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:55.577980 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-56e00665-8712-44e6-abed-a6d2796dae18 req-fe16fe35-8920-4bc3-8ea8-3981e07221bf service nova] Creating event network-changed:d4f999a9-9136-4564-a976-1c55da0fc8e7 for instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 on hv-cinder-85199 Aug 08 13:43:55.583472 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-56e00665-8712-44e6-abed-a6d2796dae18 req-fe16fe35-8920-4bc3-8ea8-3981e07221bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033401 Aug 08 13:43:55.584086 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 379/776] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:43:55.794822 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:55.795662 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:55.805936 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:55.806772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:55.807434 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:55.808661 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:55.809311 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:55.809804 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:55.918354 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f8b25a30-7eae-4e05-bbd8-c3ba43924717 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:55.919036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f8b25a30-7eae-4e05-bbd8-c3ba43924717 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:55.926905 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8b25a30-7eae-4e05-bbd8-c3ba43924717 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:55.927685 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8b25a30-7eae-4e05-bbd8-c3ba43924717 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:55.928270 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8b25a30-7eae-4e05-bbd8-c3ba43924717 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:55.928998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8b25a30-7eae-4e05-bbd8-c3ba43924717 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:55.929533 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8b25a30-7eae-4e05-bbd8-c3ba43924717 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:55.929951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f8b25a30-7eae-4e05-bbd8-c3ba43924717 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:55.972907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:55.986918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:55.989369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:55.991359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a06a1027-d537-4bd4-950b-9632f8ae3a1b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.200420 Aug 08 13:43:55.992361 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 398/777] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:43:55 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:43:56.103742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f8b25a30-7eae-4e05-bbd8-c3ba43924717 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:56.112646 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f8b25a30-7eae-4e05-bbd8-c3ba43924717 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1315 microversion: 2.1 time: 0.198957 Aug 08 13:43:56.113574 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 380/778] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:55 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:57.014671 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:57.015302 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:57.022905 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:57.023576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:57.024009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:57.024711 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:57.025159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:57.025572 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:57.134515 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-84964dcc-5b99-4652-b9d3-e175e20363f4 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:57.135317 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-84964dcc-5b99-4652-b9d3-e175e20363f4 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:57.142343 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84964dcc-5b99-4652-b9d3-e175e20363f4 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:57.142836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84964dcc-5b99-4652-b9d3-e175e20363f4 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:57.143320 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84964dcc-5b99-4652-b9d3-e175e20363f4 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:57.144106 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84964dcc-5b99-4652-b9d3-e175e20363f4 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:57.144559 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84964dcc-5b99-4652-b9d3-e175e20363f4 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:57.144985 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-84964dcc-5b99-4652-b9d3-e175e20363f4 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:57.221236 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:57.236632 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:57.239514 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:57.241679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6493890f-7531-4b68-9e9b-dff5f4fa5075 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.230877 Aug 08 13:43:57.242692 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 399/779] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:43:57 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:43:57.363594 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-84964dcc-5b99-4652-b9d3-e175e20363f4 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:57.371746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-84964dcc-5b99-4652-b9d3-e175e20363f4 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1464 microversion: 2.1 time: 0.241198 Aug 08 13:43:57.372312 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 381/780] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:57 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1464 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:43:57.418855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-76543177-e276-44de-affe-18903b3785af tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:57.419374 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-76543177-e276-44de-affe-18903b3785af tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:57.425802 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76543177-e276-44de-affe-18903b3785af tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:57.426283 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76543177-e276-44de-affe-18903b3785af tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:57.426701 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76543177-e276-44de-affe-18903b3785af tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:57.427430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76543177-e276-44de-affe-18903b3785af tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:57.427873 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76543177-e276-44de-affe-18903b3785af tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:57.428287 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-76543177-e276-44de-affe-18903b3785af tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:57.455425 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-76543177-e276-44de-affe-18903b3785af tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Going to try to terminate instance {{(pid=124408) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:43:57.550313 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-76543177-e276-44de-affe-18903b3785af tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 204 len: 0 microversion: 2.1 time: 0.134775 Aug 08 13:43:57.551153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 400/781] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:43:57 2022] DELETE /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:43:57.561222 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0af9f5f0-489a-4a36-9526-8bcac05720c3 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:57.562124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0af9f5f0-489a-4a36-9526-8bcac05720c3 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:57.569125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0af9f5f0-489a-4a36-9526-8bcac05720c3 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:57.569600 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0af9f5f0-489a-4a36-9526-8bcac05720c3 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:57.570064 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0af9f5f0-489a-4a36-9526-8bcac05720c3 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:57.570750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0af9f5f0-489a-4a36-9526-8bcac05720c3 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:57.571208 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0af9f5f0-489a-4a36-9526-8bcac05720c3 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:57.571626 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0af9f5f0-489a-4a36-9526-8bcac05720c3 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:57.714047 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0af9f5f0-489a-4a36-9526-8bcac05720c3 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:57.722527 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0af9f5f0-489a-4a36-9526-8bcac05720c3 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1470 microversion: 2.1 time: 0.166181 Aug 08 13:43:57.723125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 382/782] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:57 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:58.269322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:58.270067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:58.277965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:58.277965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:58.278476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:58.279299 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:58.279732 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:58.280230 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:58.429217 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:58.437374 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:58.438843 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:58.440052 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c163fb71-9a9c-471c-8c10-f48a2f6e424c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.176748 Aug 08 13:43:58.440615 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 401/783] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:43:58 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:43:58.744553 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b71ceca4-a7ed-4ecd-a9ab-41144ce9b752 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:58.745134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b71ceca4-a7ed-4ecd-a9ab-41144ce9b752 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:58.752392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71ceca4-a7ed-4ecd-a9ab-41144ce9b752 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:58.752868 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71ceca4-a7ed-4ecd-a9ab-41144ce9b752 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:58.753293 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71ceca4-a7ed-4ecd-a9ab-41144ce9b752 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:58.754037 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71ceca4-a7ed-4ecd-a9ab-41144ce9b752 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:58.754478 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71ceca4-a7ed-4ecd-a9ab-41144ce9b752 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:58.754902 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71ceca4-a7ed-4ecd-a9ab-41144ce9b752 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:58.899347 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b71ceca4-a7ed-4ecd-a9ab-41144ce9b752 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:58.910153 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b71ceca4-a7ed-4ecd-a9ab-41144ce9b752 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1470 microversion: 2.1 time: 0.169621 Aug 08 13:43:58.911071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 383/784] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:58 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:43:59.469364 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:59.469990 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:59.477354 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:59.477851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:59.478290 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:59.479007 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:59.479491 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:59.479913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:59.617328 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:59.626310 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:59.627844 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:43:59.629026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b05de687-f51a-491c-bfff-6a0c42233533 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.163846 Aug 08 13:43:59.629593 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 402/785] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:43:59 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:43:59.933279 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b4547473-466b-4ee2-b735-5a19cccf1587 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:43:59.933860 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b4547473-466b-4ee2-b735-5a19cccf1587 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:43:59.936318 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:43:59.941760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b4547473-466b-4ee2-b735-5a19cccf1587 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:59.942251 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b4547473-466b-4ee2-b735-5a19cccf1587 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:59.942681 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b4547473-466b-4ee2-b735-5a19cccf1587 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:43:59.943435 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b4547473-466b-4ee2-b735-5a19cccf1587 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:43:59.943949 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b4547473-466b-4ee2-b735-5a19cccf1587 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:43:59.944371 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b4547473-466b-4ee2-b735-5a19cccf1587 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:00.093071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b4547473-466b-4ee2-b735-5a19cccf1587 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baa03ceeedb4e31bd78256486e55330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60666e80b524408a8f5662afe2f0868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:00.106201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b4547473-466b-4ee2-b735-5a19cccf1587 tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 200 len: 1470 microversion: 2.1 time: 0.176828 Aug 08 13:44:00.107296 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 384/786] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:43:59 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:44:00.119422 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-fcf5cb56-ca37-4cec-b206-84ccbd3bf8ca req-8a37fc71-cee3-41f7-959c-4b64308e91d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27a0407-79f3-4b00-b28d-ad0ef9b25379", "name": "network-vif-deleted", "tag": "7614246d-f79b-43d3-994d-970f1c960aaa"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:44:00.129726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-fcf5cb56-ca37-4cec-b206-84ccbd3bf8ca req-8a37fc71-cee3-41f7-959c-4b64308e91d6 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:00.130208 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-fcf5cb56-ca37-4cec-b206-84ccbd3bf8ca req-8a37fc71-cee3-41f7-959c-4b64308e91d6 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:00.130631 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-fcf5cb56-ca37-4cec-b206-84ccbd3bf8ca req-8a37fc71-cee3-41f7-959c-4b64308e91d6 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:00.143517 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-fcf5cb56-ca37-4cec-b206-84ccbd3bf8ca req-8a37fc71-cee3-41f7-959c-4b64308e91d6 service nova] Creating event network-vif-deleted:7614246d-f79b-43d3-994d-970f1c960aaa for instance c27a0407-79f3-4b00-b28d-ad0ef9b25379 on hv-cinder-85199 Aug 08 13:44:00.148883 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-fcf5cb56-ca37-4cec-b206-84ccbd3bf8ca req-8a37fc71-cee3-41f7-959c-4b64308e91d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033178 Aug 08 13:44:00.149540 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 403/787] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:00.654318 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:00.654927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:00.661332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:00.661806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:00.662242 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:00.662941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:00.663417 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:00.663884 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:00.854422 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:00.863585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:00.865216 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:00.866584 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-214c9e7f-9472-4194-8928-568e78f00d5c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.216295 Aug 08 13:44:00.867262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 385/788] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:00 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:01.130956 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:01.131722 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] [instance: c27a0407-79f3-4b00-b28d-ad0ef9b25379] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:01.138816 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:01.139331 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:01.139743 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:01.140480 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:01.140934 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:01.141328 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:01.159180 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] HTTP exception thrown: Instance c27a0407-79f3-4b00-b28d-ad0ef9b25379 could not be found. Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Request method failure captured: Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 HTTP/1.1 Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8RMNj169TY4pqLytADWfBJyzJekWc7mxVQA8VPb5TEqQg3haWdClB8nqfgAnjPad2e-vbRJVajSq8aVeLWEMlQ7myWNIikR92873GVpQ7coSHPF_0xR_4BkUjyI963C5FZm07I2Lx2gaMw-vhlYW8SxVZ0076aBkDB4HMQBwyzrD8mM Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: a60666e80b524408a8f5662afe2f0868 Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-VolumesNegativeTest-1389911611 Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:44:01.160879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60666e80b524408a8f5662afe2f0868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a60666e80b524408a8f5662afe2f0868"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60666e80b524408a8f5662afe2f0868"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a60666e80b524408a8f5662afe2f0868"}]}] Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-VolumesNegativeTest-1389911611 Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: a60666e80b524408a8f5662afe2f0868 Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-VolumesNegativeTest-1389911611 Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-VolumesNegativeTest-1389911611-project Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: 5baa03ceeedb4e31bd78256486e55330 Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-VolumesNegativeTest-1389911611-project Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance c27a0407-79f3-4b00-b28d-ad0ef9b25379 could not be found. Aug 08 13:44:01.163164 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': 'c27a0407-79f3-4b00-b28d-ad0ef9b25379'} Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c27a0407-79f3-4b00-b28d-ad0ef9b25379 could not be found. Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:44:01.165257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c27a0407-79f3-4b00-b28d-ad0ef9b25379 could not be found. Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c27a0407-79f3-4b00-b28d-ad0ef9b25379 could not be found. Aug 08 13:44:01.168151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:44:01.170334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] Returning 404 to user: Instance c27a0407-79f3-4b00-b28d-ad0ef9b25379 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:44:01.170334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-06586f73-6608-4cc2-85eb-88a21269761f tempest-VolumesNegativeTest-1389911611 tempest-VolumesNegativeTest-1389911611-project] 10.222.0.33 "GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379" status: 404 len: 111 microversion: 2.1 time: 0.037757 Aug 08 13:44:01.170334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 404/789] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:44:01 2022] GET /compute/v2.1/servers/c27a0407-79f3-4b00-b28d-ad0ef9b25379 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:44:01.907831 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:01.908589 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:01.919797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:01.921043 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:01.921804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:01.923108 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:01.924157 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:01.924911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:02.106179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:02.114853 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:02.116368 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:02.117633 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e516e038-46d6-4f53-8272-e2aaeb238db3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.214560 Aug 08 13:44:02.118243 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 386/790] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:01 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:03.143002 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:03.144365 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:03.152597 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:03.153089 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:03.153518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:03.154235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:03.154690 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:03.155199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:03.177944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:44:03.346115 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:03.357411 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:03.359010 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:03.360467 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b743c215-225e-4f1f-9f93-14c4baa83531 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1745 microversion: 2.20 time: 0.221751 Aug 08 13:44:03.361041 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 405/791] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:03 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:04.398080 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:04.399406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:04.409301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:04.410249 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:04.411179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:04.412501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:04.413254 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:04.413981 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:04.568575 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:04.577195 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:04.578701 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:04.579929 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-aa1b79b6-d51c-41b7-8961-595eff89c194 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1745 microversion: 2.20 time: 0.189282 Aug 08 13:44:04.580502 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 387/792] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:04 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1745 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:05.605131 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:05.605746 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:05.612613 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:05.613078 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:05.613510 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:05.614213 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:05.614652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:05.615153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:05.773067 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:05.782650 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:05.784462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:05.786527 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-237953ed-ae8b-4fa9-ad18-1217cc022fd6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1745 microversion: 2.20 time: 0.185946 Aug 08 13:44:05.787401 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 406/793] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:05 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:44:06.810097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:06.810706 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:06.817788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:06.818267 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:06.818689 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:06.819424 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:06.819866 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:06.820278 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:06.962467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:06.970826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:06.972750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:06.973922 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ff47857b-eba5-49ef-be68-9a9691b4b4af tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1745 microversion: 2.20 time: 0.167868 Aug 08 13:44:06.975050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 388/794] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:06 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:07.814608 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-92f98aa7-1ced-49d3-8b9a-492059f2548e req-860b0fb8-7ec9-4a41-806d-7e8be17d3275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f5ea81-40a9-4734-8c39-c5f0a2a55bab", "name": "network-vif-plugged", "status": "completed", "tag": "5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:44:07.827046 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-92f98aa7-1ced-49d3-8b9a-492059f2548e req-860b0fb8-7ec9-4a41-806d-7e8be17d3275 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:07.827718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-92f98aa7-1ced-49d3-8b9a-492059f2548e req-860b0fb8-7ec9-4a41-806d-7e8be17d3275 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:07.828147 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-92f98aa7-1ced-49d3-8b9a-492059f2548e req-860b0fb8-7ec9-4a41-806d-7e8be17d3275 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:07.840583 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-92f98aa7-1ced-49d3-8b9a-492059f2548e req-860b0fb8-7ec9-4a41-806d-7e8be17d3275 service nova] Creating event network-vif-plugged:5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5 for instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab on hv-cinder-85199 Aug 08 13:44:07.845823 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-92f98aa7-1ced-49d3-8b9a-492059f2548e req-860b0fb8-7ec9-4a41-806d-7e8be17d3275 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034979 Aug 08 13:44:07.846801 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 407/795] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:08.006074 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:08.006640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:08.017041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:08.017628 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:08.018269 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:08.019421 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:08.019940 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:08.020484 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:08.167168 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:08.176059 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:08.177567 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:08.178750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ffecd178-1678-4699-b328-bfaa8ab73f13 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1745 microversion: 2.20 time: 0.179290 Aug 08 13:44:08.179367 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 389/796] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:07 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:09.203485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:09.204206 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:09.211525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:09.212009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:09.212419 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:09.213132 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:09.213588 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:09.214005 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:09.364388 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:09.373415 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:09.374970 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:09.376230 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-80ce94f9-6fac-4409-84bf-f2feadb81a6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1745 microversion: 2.20 time: 0.177444 Aug 08 13:44:09.376807 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 408/797] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:09 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:10.415270 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:10.416174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:10.422966 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:10.423604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:10.424299 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:10.425246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:10.425901 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:10.426527 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:10.608022 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:10.618852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:10.621093 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:10.622313 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ca3c420c-b9ed-4ee3-8ba1-5f430b5b2d7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1740 microversion: 2.20 time: 0.211269 Aug 08 13:44:10.623184 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 390/798] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:10 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:44:11.662204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:11.666956 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:11.679992 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:11.681159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:11.682199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:11.683845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:11.685072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:11.686173 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:11.905631 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:11.920830 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:11.922777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:11.924094 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-194f309e-008c-4ce3-b1bf-232ac0ebab16 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1740 microversion: 2.20 time: 0.269557 Aug 08 13:44:11.924703 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 409/799] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:11 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:12.958432 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:12.960715 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:12.970430 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:12.971615 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:12.972220 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:12.973236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:12.973948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:12.974606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:12.980005 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=100 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:44:13.164345 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:13.182287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:13.186050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:13.188584 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d3ed6c56-4c15-48fc-86fe-c717f1a1137a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1740 microversion: 2.20 time: 0.235548 Aug 08 13:44:13.189476 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 391/800] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:12 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:14.224091 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:14.224728 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:14.231760 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:14.232246 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:14.232682 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:14.233555 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:14.233924 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:14.234359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:14.423783 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:14.439202 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:14.441469 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:14.444560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a870f75a-290d-47eb-9074-2a62f8e27071 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1740 microversion: 2.20 time: 0.225005 Aug 08 13:44:14.447426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 410/801] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:14 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:15.486678 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:15.487368 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:15.494836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:15.495373 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:15.495801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:15.496591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:15.496961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:15.497577 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:15.700907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:15.711981 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:15.713655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:15.714889 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-35aa60ab-f2f3-4809-b00a-7bd753a4bf8d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1740 microversion: 2.20 time: 0.232358 Aug 08 13:44:15.715504 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 392/802] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:15 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:16.741697 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:16.743551 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:16.756991 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:16.757833 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:16.758656 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:16.760159 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:16.761330 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:16.762569 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:16.932428 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:16.946591 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:16.950208 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:16.952475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-953fc743-4c30-44f9-8520-5e24e9c4906a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1740 microversion: 2.20 time: 0.217688 Aug 08 13:44:16.953601 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 411/803] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:16 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:17.986342 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:17.988428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:18.000456 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:18.001846 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:18.002608 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:18.004114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:18.004932 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:18.006517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:18.211681 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:18.221398 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:18.223410 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:18.224861 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e0b47e7d-3866-4636-b73f-41ca55be91fb tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1740 microversion: 2.20 time: 0.245879 Aug 08 13:44:18.225624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 393/804] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:17 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:19.248253 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:19.248862 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:19.255776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:19.256596 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:19.257063 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:19.257847 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:19.258288 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:19.258711 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:19.479948 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:19.489802 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:19.491487 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:19.492970 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a348eb5f-a7c2-450e-a699-413819bf5987 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1740 microversion: 2.20 time: 0.249016 Aug 08 13:44:19.493681 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 412/805] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:19 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:20.517388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:20.518029 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:20.524951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:20.525437 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:20.525858 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:20.526558 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:20.527001 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:20.527706 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:20.673460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:20.682902 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:20.684513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:20.685716 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-85044c44-5690-445e-ac20-e4999bf8816c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1740 microversion: 2.20 time: 0.172368 Aug 08 13:44:20.686296 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 394/806] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:20 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:21.717571 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:21.718199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:21.721369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:44:21.727456 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:21.727973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:21.728404 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:21.729238 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:21.729681 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:21.730096 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:21.874428 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:21.883437 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:21.885092 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:21.886321 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bd47228d-08e1-4118-8f48-4dbee9882454 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1722 microversion: 2.20 time: 0.172918 Aug 08 13:44:21.886882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 413/807] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:21 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:44:22.910825 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:22.911461 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:22.918391 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:22.918857 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:22.919300 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:22.920015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:22.920457 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:22.920876 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:23.065153 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:23.075652 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:23.077662 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:23.079299 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-235cf8c1-e4e6-4cc0-bcad-42258a90b42c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1722 microversion: 2.20 time: 0.172692 Aug 08 13:44:23.079855 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 395/808] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:22 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:23.374286 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-84606a5b-b56e-45a8-a0df-6dbf092d3d79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:23.374920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-84606a5b-b56e-45a8-a0df-6dbf092d3d79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:23.381776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84606a5b-b56e-45a8-a0df-6dbf092d3d79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:23.382296 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84606a5b-b56e-45a8-a0df-6dbf092d3d79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:23.383438 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84606a5b-b56e-45a8-a0df-6dbf092d3d79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:23.384148 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84606a5b-b56e-45a8-a0df-6dbf092d3d79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:23.384594 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84606a5b-b56e-45a8-a0df-6dbf092d3d79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:23.385008 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-84606a5b-b56e-45a8-a0df-6dbf092d3d79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:23.410266 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-84606a5b-b56e-45a8-a0df-6dbf092d3d79 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/ips" status: 200 len: 145 microversion: 2.1 time: 0.039519 Aug 08 13:44:23.411011 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 414/809] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 13:44:23 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:23.904408 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-beee1793-8fff-40d0-b144-33b735420c3a req-1b508b03-b352-4d37-8c5a-93199889d035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f5ea81-40a9-4734-8c39-c5f0a2a55bab", "name": "network-vif-unplugged", "status": "completed", "tag": "5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:44:23.914763 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-beee1793-8fff-40d0-b144-33b735420c3a req-1b508b03-b352-4d37-8c5a-93199889d035 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:23.915978 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-beee1793-8fff-40d0-b144-33b735420c3a req-1b508b03-b352-4d37-8c5a-93199889d035 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:23.915978 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-beee1793-8fff-40d0-b144-33b735420c3a req-1b508b03-b352-4d37-8c5a-93199889d035 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:23.927496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.compute.server_external_events [req-beee1793-8fff-40d0-b144-33b735420c3a req-1b508b03-b352-4d37-8c5a-93199889d035 service nova] Unable to find a host for instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab. Dropping event network-vif-unplugged {{(pid=124407) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 13:44:23.928415 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-beee1793-8fff-40d0-b144-33b735420c3a req-1b508b03-b352-4d37-8c5a-93199889d035 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030926 Aug 08 13:44:23.929022 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 396/810] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 08 13:44:24.110458 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:24.111583 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:24.119858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:24.120425 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:24.121107 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:24.121914 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:24.122451 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:24.122851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:24.267996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:24.277472 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:24.279005 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:24.280417 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-219b2a08-2e42-4efd-b047-549ec217276e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1665 microversion: 2.20 time: 0.175096 Aug 08 13:44:24.281026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 415/811] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:24 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1665 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:24.303601 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-761ea7af-e7ee-4401-b662-fb765810f697 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09cbdb8a-af67-4e90-9d64-7861f1e7e2f9"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:44:24.305946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-761ea7af-e7ee-4401-b662-fb765810f697 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:24.312678 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-761ea7af-e7ee-4401-b662-fb765810f697 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:24.313175 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-761ea7af-e7ee-4401-b662-fb765810f697 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:24.313617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-761ea7af-e7ee-4401-b662-fb765810f697 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:24.314321 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-761ea7af-e7ee-4401-b662-fb765810f697 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:24.314765 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-761ea7af-e7ee-4401-b662-fb765810f697 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:24.315212 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-761ea7af-e7ee-4401-b662-fb765810f697 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:24.628006 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-761ea7af-e7ee-4401-b662-fb765810f697 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "POST /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.328367 Aug 08 13:44:24.628894 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 397/812] 10.222.0.33 () {62 vars in 1364 bytes} [Mon Aug 8 13:44:24 2022] POST /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/os-volume_attachments => generated 188 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 13:44:24.775424 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-90a2e50b-b419-4eca-b168-06dbf082c239 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:24.776015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-90a2e50b-b419-4eca-b168-06dbf082c239 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:24.784963 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90a2e50b-b419-4eca-b168-06dbf082c239 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:24.785461 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90a2e50b-b419-4eca-b168-06dbf082c239 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:24.785894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90a2e50b-b419-4eca-b168-06dbf082c239 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:24.786661 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90a2e50b-b419-4eca-b168-06dbf082c239 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:24.787118 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90a2e50b-b419-4eca-b168-06dbf082c239 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:24.787585 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-90a2e50b-b419-4eca-b168-06dbf082c239 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:24.817481 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4d3377c1-1457-47a4-b379-ff48b3e8c5a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceb247e5-4e2d-4f2d-b1af-6396df99ef55"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:44:24.820097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4d3377c1-1457-47a4-b379-ff48b3e8c5a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:24.827247 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4d3377c1-1457-47a4-b379-ff48b3e8c5a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:24.827889 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4d3377c1-1457-47a4-b379-ff48b3e8c5a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:24.828306 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4d3377c1-1457-47a4-b379-ff48b3e8c5a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:24.829077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4d3377c1-1457-47a4-b379-ff48b3e8c5a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:24.829795 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4d3377c1-1457-47a4-b379-ff48b3e8c5a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:24.830277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4d3377c1-1457-47a4-b379-ff48b3e8c5a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:25.096249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-90a2e50b-b419-4eca-b168-06dbf082c239 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/os-volume_attachments/09cbdb8a-af67-4e90-9d64-7861f1e7e2f9" status: 202 len: 0 microversion: 2.20 time: 0.324320 Aug 08 13:44:25.097187 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 416/813] 10.222.0.33 () {60 vars in 1457 bytes} [Mon Aug 8 13:44:24 2022] DELETE /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/os-volume_attachments/09cbdb8a-af67-4e90-9d64-7861f1e7e2f9 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:44:25.175800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4d3377c1-1457-47a4-b379-ff48b3e8c5a6 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361778 Aug 08 13:44:25.182009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 398/814] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:44:24 2022] POST /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:25.183048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1e94bd95-6d49-4451-b3b8-999ad447ba89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:44:25.184274 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1e94bd95-6d49-4451-b3b8-999ad447ba89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:25.196310 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1e94bd95-6d49-4451-b3b8-999ad447ba89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:25.197176 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1e94bd95-6d49-4451-b3b8-999ad447ba89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:25.197948 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1e94bd95-6d49-4451-b3b8-999ad447ba89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:25.199384 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1e94bd95-6d49-4451-b3b8-999ad447ba89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:25.200249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1e94bd95-6d49-4451-b3b8-999ad447ba89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:25.201053 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1e94bd95-6d49-4451-b3b8-999ad447ba89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:25.238982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1e94bd95-6d49-4451-b3b8-999ad447ba89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124408) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 13:44:25.318461 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1e94bd95-6d49-4451-b3b8-999ad447ba89 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "POST /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/action" status: 202 len: 0 microversion: 2.20 time: 0.143677 Aug 08 13:44:25.319137 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 417/815] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Aug 8 13:44:25 2022] POST /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 13:44:25.334832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:25.336115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:25.348379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:25.350116 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:25.351168 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:25.352179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:25.352988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:25.353684 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:25.569804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:25.584454 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:25.587718 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:25.590052 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-372bd873-3f8d-4fd1-b170-7e43ca6e7e52 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1673 microversion: 2.20 time: 0.264197 Aug 08 13:44:25.591551 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 399/816] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:25 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1673 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:26.617856 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:26.618451 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:26.625494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:26.625976 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:26.626406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:26.627183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:26.627635 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:26.628057 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:26.769886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:26.779380 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:26.780866 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:26.782364 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-da407aec-e87c-4db4-a52b-62bd20253ae9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1675 microversion: 2.20 time: 0.169212 Aug 08 13:44:26.782939 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 418/817] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:26 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:27.487232 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9a018c18-e534-4f30-83af-4fe63889115f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:27.489591 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9a018c18-e534-4f30-83af-4fe63889115f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:27.497800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a018c18-e534-4f30-83af-4fe63889115f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:27.498833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a018c18-e534-4f30-83af-4fe63889115f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:27.499463 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a018c18-e534-4f30-83af-4fe63889115f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:27.500180 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a018c18-e534-4f30-83af-4fe63889115f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:27.500624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a018c18-e534-4f30-83af-4fe63889115f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:27.501041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9a018c18-e534-4f30-83af-4fe63889115f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:27.536453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9a018c18-e534-4f30-83af-4fe63889115f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053275 Aug 08 13:44:27.537230 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 400/818] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:44:27 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:27.552638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2ea30372-cecc-40ba-8943-1ffc45b67241 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:27.552638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2ea30372-cecc-40ba-8943-1ffc45b67241 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:27.555235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2ea30372-cecc-40ba-8943-1ffc45b67241 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:27.555730 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2ea30372-cecc-40ba-8943-1ffc45b67241 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:27.556163 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2ea30372-cecc-40ba-8943-1ffc45b67241 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:27.556886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2ea30372-cecc-40ba-8943-1ffc45b67241 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:27.557334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2ea30372-cecc-40ba-8943-1ffc45b67241 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:27.557752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2ea30372-cecc-40ba-8943-1ffc45b67241 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:27.576513 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:44:27.591320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2ea30372-cecc-40ba-8943-1ffc45b67241 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments/ceb247e5-4e2d-4f2d-b1af-6396df99ef55" status: 200 len: 194 microversion: 2.1 time: 0.047225 Aug 08 13:44:27.592014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 419/819] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Aug 8 13:44:27 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments/ceb247e5-4e2d-4f2d-b1af-6396df99ef55 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:27.810202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:27.811348 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:27.818613 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:27.819115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:27.819764 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:27.820439 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:27.820910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:27.821520 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:28.061428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:28.069874 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:28.071401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:28.072596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-26f7684e-fee7-4ba0-9a96-da9a1be4a303 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.266614 Aug 08 13:44:28.073168 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 401/820] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:27 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:28.989021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d50c1942-29c6-45ab-ac22-c894704cf5b5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4febdeb-f438-4ef1-a9a1-bcacd35dfa6e"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:44:28.992875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d50c1942-29c6-45ab-ac22-c894704cf5b5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:29.002673 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d50c1942-29c6-45ab-ac22-c894704cf5b5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:29.003194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d50c1942-29c6-45ab-ac22-c894704cf5b5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:29.003850 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d50c1942-29c6-45ab-ac22-c894704cf5b5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:29.007131 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d50c1942-29c6-45ab-ac22-c894704cf5b5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:29.007131 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d50c1942-29c6-45ab-ac22-c894704cf5b5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:29.007131 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d50c1942-29c6-45ab-ac22-c894704cf5b5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:29.097809 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:29.098392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:29.105158 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:29.105643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:29.106238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:29.106939 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:29.107475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:29.107907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:29.249331 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:29.258780 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:29.259766 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:29.261877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-44251067-0ee8-493f-b8ce-e235130b7d6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.167876 Aug 08 13:44:29.272032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 402/821] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:29 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:44:30.288443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:30.289245 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:30.291777 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=38 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:44:30.297587 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:30.298077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:30.298507 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:30.299247 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:30.299696 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:30.300112 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:30.475237 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:30.484489 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:30.486242 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:30.487547 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b9bc5380-1b87-4d48-88eb-d1f4c0fda98a tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.205178 Aug 08 13:44:30.499881 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 403/822] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:30 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:44:31.514277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:31.515030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:31.521658 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:31.522145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:31.522586 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:31.523353 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:31.523805 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:31.524233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:31.546202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:44:31.694317 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:31.708510 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:31.710725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:31.710725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c3aa2240-c71d-4b83-8b2e-73319eaadfbf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.202910 Aug 08 13:44:31.710725 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 404/823] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:31 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:32.742752 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:32.744489 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:32.753071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:32.753873 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:32.754618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:32.755951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:32.756729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:32.757491 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:32.928353 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:32.937190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:32.938707 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:32.939896 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c042ec4f-0760-4d44-9aed-c739f012852e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.201454 Aug 08 13:44:32.941193 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 405/824] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:32 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:44:33.967860 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:33.969079 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:33.980774 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:33.981704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:33.982519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:33.983853 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:33.984743 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:33.985522 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:34.158387 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:34.168074 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:34.169802 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:34.171131 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-bdbeef4c-6caf-40fa-af61-914dbba61e1d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.210957 Aug 08 13:44:34.172114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 406/825] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:33 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:35.205479 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:35.206761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:35.213583 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:35.214085 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:35.214525 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:35.215387 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:35.215855 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:35.216288 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:35.391436 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:35.401746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:35.403409 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:35.404833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c422d4f4-22b4-4da5-884d-51e427e564b1 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.203514 Aug 08 13:44:35.415646 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 407/826] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:35 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:36.443896 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:36.444683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:36.451793 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:36.452282 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:36.452806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:36.453443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:36.453919 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:36.454338 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:36.642081 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:36.656593 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:36.659677 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:36.661833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-754de73e-59d7-483d-bdc0-2fdf46ce270f tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.221762 Aug 08 13:44:36.662856 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 408/827] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:36 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:37.690805 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:37.691885 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:37.704018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:37.704893 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:37.705673 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:37.706896 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:37.707752 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:37.708547 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:37.869849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:37.880176 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:37.881709 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:37.882957 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-50fe0b8e-3bc8-4162-a0dd-5ab273f2cf8b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.199582 Aug 08 13:44:37.883554 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 409/828] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:37 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:44:38.918187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:38.918963 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:38.926935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:38.926935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:38.926935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:38.926935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:38.931936 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:38.931936 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:39.000824 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:44:39.083222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=8 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:44:39.098309 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:39.107485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:39.109089 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:39.110325 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-dfe5a0f3-e469-48f4-9bb3-145fb8a99f43 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.196274 Aug 08 13:44:39.110903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 410/829] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:38 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:40.133668 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:40.134395 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:40.141145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:40.141621 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:40.142043 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:40.142762 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:40.143249 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:40.143666 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:40.277324 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:40.285897 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:40.287408 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:40.288569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5c57dc49-45ba-4093-8c05-d7994778f085 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.158912 Aug 08 13:44:40.289138 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 411/830] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:40 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:41.314541 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:41.316323 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:41.323646 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:41.324182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:41.324674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:41.325531 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:41.326116 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:41.326783 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:41.487953 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:41.496689 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:41.498212 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:41.499505 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d75f47c5-8f51-4f79-8f80-4dd8752a32f4 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.190443 Aug 08 13:44:41.500077 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 412/831] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:41 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:42.525740 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:42.526929 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:42.534182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:42.534656 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:42.535102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:42.535806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:42.536252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:42.536705 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:42.679841 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:42.692419 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:42.694841 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:42.697194 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5ab5ad2a-0373-46cb-b066-26982c999e6c tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.177318 Aug 08 13:44:42.698043 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 413/832] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:42 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:43.547101 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d50c1942-29c6-45ab-ac22-c894704cf5b5 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "POST /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.563654 Aug 08 13:44:43.548001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 420/833] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:44:28 2022] POST /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments => generated 194 bytes in 14566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:43.726468 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:43.727112 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:43.734135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:43.734730 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:43.735453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:43.736441 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:43.737073 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:43.737575 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:43.872860 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:43.881378 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:43.882921 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:43.884102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c63ee5cf-c323-4208-8fdd-0a5a30f74263 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.165932 Aug 08 13:44:43.884704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 414/834] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:43 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:44.909061 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:44.909753 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:44.916677 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:44.917179 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:44.917600 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:44.918308 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:44.918748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:44.919202 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:45.084322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:45.095665 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:45.097471 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:45.098878 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-45a190cc-2db8-4123-989e-f0499666ad6b tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.194699 Aug 08 13:44:45.099603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 421/835] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:44 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:45.970385 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-abb160fc-2efe-465b-ad07-99a23f380df6 req-4870038b-944a-43e8-bbb0-ced26764505f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f5ea81-40a9-4734-8c39-c5f0a2a55bab", "name": "network-vif-plugged", "status": "completed", "tag": "5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:44:45.980994 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-abb160fc-2efe-465b-ad07-99a23f380df6 req-4870038b-944a-43e8-bbb0-ced26764505f service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:45.981621 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-abb160fc-2efe-465b-ad07-99a23f380df6 req-4870038b-944a-43e8-bbb0-ced26764505f service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:45.982053 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-abb160fc-2efe-465b-ad07-99a23f380df6 req-4870038b-944a-43e8-bbb0-ced26764505f service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:45.994053 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-abb160fc-2efe-465b-ad07-99a23f380df6 req-4870038b-944a-43e8-bbb0-ced26764505f service nova] Creating event network-vif-plugged:5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5 for instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab on hv-cinder-85199 Aug 08 13:44:45.999301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-abb160fc-2efe-465b-ad07-99a23f380df6 req-4870038b-944a-43e8-bbb0-ced26764505f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033197 Aug 08 13:44:46.000007 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 415/836] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:46.124448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:46.125085 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:46.133906 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:46.134410 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:46.134848 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:46.136248 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:46.136721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:46.137397 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:46.336186 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:46.345897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:46.347623 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:46.348948 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0e98f016-7a32-4e68-86c8-e04f89238b68 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.229335 Aug 08 13:44:46.349516 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 422/837] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:46 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:47.376119 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:47.376710 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:47.384004 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:47.384497 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:47.384928 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:47.385686 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:47.386649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:47.386649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:47.532683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:47.545140 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:47.547995 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:47.549535 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5973f9f3-765a-4546-aae2-6d27599d2ad3 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.179157 Aug 08 13:44:47.550334 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 416/838] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:47 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:48.587015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:48.587700 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:48.595183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:48.595736 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:48.596211 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:48.596930 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:48.597375 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:48.597795 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:48.739331 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:48.748075 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:48.749558 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:48.750863 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3b705fa8-d75a-411b-ab8c-e0a5722e271d tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1731 microversion: 2.20 time: 0.168230 Aug 08 13:44:48.751542 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 423/839] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:48 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 13:44:49.778514 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:49.779248 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:49.786641 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:49.787124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:49.787569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:49.788273 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:49.788727 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:49.789142 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:50.209088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:50.218195 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:50.220096 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:50.221289 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d99c6d04-8c06-476d-bb52-ab32d4bbf2e9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1718 microversion: 2.20 time: 0.447266 Aug 08 13:44:50.221866 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 417/840] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:44:49 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1718 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:44:51.136445 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-cb29c800-9df1-4805-af40-f1ce38f3fa6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:51.138709 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-cb29c800-9df1-4805-af40-f1ce38f3fa6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:51.145670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cb29c800-9df1-4805-af40-f1ce38f3fa6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:51.146181 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cb29c800-9df1-4805-af40-f1ce38f3fa6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:51.146612 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cb29c800-9df1-4805-af40-f1ce38f3fa6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:51.147343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cb29c800-9df1-4805-af40-f1ce38f3fa6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:51.147799 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cb29c800-9df1-4805-af40-f1ce38f3fa6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:51.148217 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cb29c800-9df1-4805-af40-f1ce38f3fa6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:51.178825 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-cb29c800-9df1-4805-af40-f1ce38f3fa6c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046259 Aug 08 13:44:51.179433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 424/841] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:44:51 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:51.319958 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a690b8ac-0337-4295-8639-9e6974cc449f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:51.320676 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a690b8ac-0337-4295-8639-9e6974cc449f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:51.327715 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a690b8ac-0337-4295-8639-9e6974cc449f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:51.328224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a690b8ac-0337-4295-8639-9e6974cc449f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:51.328652 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a690b8ac-0337-4295-8639-9e6974cc449f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:51.329357 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a690b8ac-0337-4295-8639-9e6974cc449f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:51.329802 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a690b8ac-0337-4295-8639-9e6974cc449f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:51.330224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a690b8ac-0337-4295-8639-9e6974cc449f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:51.361862 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a690b8ac-0337-4295-8639-9e6974cc449f tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments/ceb247e5-4e2d-4f2d-b1af-6396df99ef55" status: 200 len: 194 microversion: 2.1 time: 0.046004 Aug 08 13:44:51.362475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 418/842] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Aug 8 13:44:51 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments/ceb247e5-4e2d-4f2d-b1af-6396df99ef55 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:51.373390 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-28cc033e-b7e0-48f8-802b-e37fa4463988 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:51.373885 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-28cc033e-b7e0-48f8-802b-e37fa4463988 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:51.380929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-28cc033e-b7e0-48f8-802b-e37fa4463988 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:51.381397 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-28cc033e-b7e0-48f8-802b-e37fa4463988 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:51.381849 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-28cc033e-b7e0-48f8-802b-e37fa4463988 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:51.382622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-28cc033e-b7e0-48f8-802b-e37fa4463988 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:51.383072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-28cc033e-b7e0-48f8-802b-e37fa4463988 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:51.383523 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-28cc033e-b7e0-48f8-802b-e37fa4463988 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:51.472675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-28cc033e-b7e0-48f8-802b-e37fa4463988 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lazy-loading 'services' on Instance uuid 9dfd4416-ef05-480e-991b-2f18443ac75b {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:44:51.552243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-28cc033e-b7e0-48f8-802b-e37fa4463988 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments/ceb247e5-4e2d-4f2d-b1af-6396df99ef55" status: 202 len: 0 microversion: 2.1 time: 0.182786 Aug 08 13:44:51.552837 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 425/843] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:44:51 2022] DELETE /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments/ceb247e5-4e2d-4f2d-b1af-6396df99ef55 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:44:53.754258 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ee85775b-0891-4733-a49b-bc0d6005b0ac tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:53.754842 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ee85775b-0891-4733-a49b-bc0d6005b0ac tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:53.762231 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee85775b-0891-4733-a49b-bc0d6005b0ac tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:53.762905 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee85775b-0891-4733-a49b-bc0d6005b0ac tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:53.763464 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee85775b-0891-4733-a49b-bc0d6005b0ac tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:53.764419 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee85775b-0891-4733-a49b-bc0d6005b0ac tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:53.764974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee85775b-0891-4733-a49b-bc0d6005b0ac tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:53.765498 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee85775b-0891-4733-a49b-bc0d6005b0ac tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:53.801472 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ee85775b-0891-4733-a49b-bc0d6005b0ac tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments/b4febdeb-f438-4ef1-a9a1-bcacd35dfa6e" status: 200 len: 194 microversion: 2.1 time: 0.051617 Aug 08 13:44:53.802112 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 419/844] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Aug 8 13:44:53 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments/b4febdeb-f438-4ef1-a9a1-bcacd35dfa6e => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:53.816214 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-19e2538c-f804-4c15-acf8-32c9ee1319fc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:53.817119 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-19e2538c-f804-4c15-acf8-32c9ee1319fc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:53.823968 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-19e2538c-f804-4c15-acf8-32c9ee1319fc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:53.824438 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-19e2538c-f804-4c15-acf8-32c9ee1319fc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:53.824874 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-19e2538c-f804-4c15-acf8-32c9ee1319fc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:53.825579 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-19e2538c-f804-4c15-acf8-32c9ee1319fc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:53.826017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-19e2538c-f804-4c15-acf8-32c9ee1319fc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:53.826427 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-19e2538c-f804-4c15-acf8-32c9ee1319fc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:53.922396 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-19e2538c-f804-4c15-acf8-32c9ee1319fc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lazy-loading 'services' on Instance uuid 9dfd4416-ef05-480e-991b-2f18443ac75b {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:44:54.004603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-19e2538c-f804-4c15-acf8-32c9ee1319fc tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments/b4febdeb-f438-4ef1-a9a1-bcacd35dfa6e" status: 202 len: 0 microversion: 2.1 time: 0.193890 Aug 08 13:44:54.005426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 426/845] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:44:53 2022] DELETE /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments/b4febdeb-f438-4ef1-a9a1-bcacd35dfa6e => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 13:44:55.220995 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-270b54e8-37ca-42cd-a43d-930041a8a445 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:55.223328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-270b54e8-37ca-42cd-a43d-930041a8a445 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:55.230700 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-270b54e8-37ca-42cd-a43d-930041a8a445 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:55.231295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-270b54e8-37ca-42cd-a43d-930041a8a445 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:55.231768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-270b54e8-37ca-42cd-a43d-930041a8a445 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:55.232510 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-270b54e8-37ca-42cd-a43d-930041a8a445 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:55.233007 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-270b54e8-37ca-42cd-a43d-930041a8a445 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:55.233445 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-270b54e8-37ca-42cd-a43d-930041a8a445 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:55.267224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-270b54e8-37ca-42cd-a43d-930041a8a445 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050493 Aug 08 13:44:55.267807 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 420/846] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:44:55 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 13:44:55.407609 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e3ad7c8b-9fed-499e-b33e-008d2b4783d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:55.411656 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e3ad7c8b-9fed-499e-b33e-008d2b4783d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:55.423004 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ad7c8b-9fed-499e-b33e-008d2b4783d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:55.423743 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ad7c8b-9fed-499e-b33e-008d2b4783d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:55.424415 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ad7c8b-9fed-499e-b33e-008d2b4783d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:55.425700 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ad7c8b-9fed-499e-b33e-008d2b4783d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:55.426400 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ad7c8b-9fed-499e-b33e-008d2b4783d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:55.427073 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e3ad7c8b-9fed-499e-b33e-008d2b4783d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:55.463500 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e3ad7c8b-9fed-499e-b33e-008d2b4783d8 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064062 Aug 08 13:44:55.464113 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 427/847] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:44:55 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 13:44:55.532572 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-82a12bde-10bb-4a69-b6ce-4e9416cd3309 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:55.533048 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-82a12bde-10bb-4a69-b6ce-4e9416cd3309 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:55.539532 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82a12bde-10bb-4a69-b6ce-4e9416cd3309 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:55.540014 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82a12bde-10bb-4a69-b6ce-4e9416cd3309 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:55.540438 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82a12bde-10bb-4a69-b6ce-4e9416cd3309 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:55.541150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82a12bde-10bb-4a69-b6ce-4e9416cd3309 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:55.541587 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82a12bde-10bb-4a69-b6ce-4e9416cd3309 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:55.541996 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82a12bde-10bb-4a69-b6ce-4e9416cd3309 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:55.570532 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-82a12bde-10bb-4a69-b6ce-4e9416cd3309 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:44:55.573801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=100 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:44:55.663332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-82a12bde-10bb-4a69-b6ce-4e9416cd3309 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 204 len: 0 microversion: 2.1 time: 0.134089 Aug 08 13:44:55.664117 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 421/848] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:44:55 2022] DELETE /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:44:55.674660 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-895eea8f-26da-430b-a3e0-0f1545d43e5c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:55.675327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-895eea8f-26da-430b-a3e0-0f1545d43e5c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:55.687996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-895eea8f-26da-430b-a3e0-0f1545d43e5c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:55.689243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-895eea8f-26da-430b-a3e0-0f1545d43e5c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:55.690314 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-895eea8f-26da-430b-a3e0-0f1545d43e5c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:55.692233 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-895eea8f-26da-430b-a3e0-0f1545d43e5c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:55.693370 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-895eea8f-26da-430b-a3e0-0f1545d43e5c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:55.694545 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-895eea8f-26da-430b-a3e0-0f1545d43e5c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:55.888483 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-895eea8f-26da-430b-a3e0-0f1545d43e5c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:55.897544 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-895eea8f-26da-430b-a3e0-0f1545d43e5c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1674 microversion: 2.1 time: 0.226935 Aug 08 13:44:55.898302 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 428/849] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:44:55 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:44:56.920424 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-296c4ed7-ad83-4925-8813-371510882c8b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:56.921113 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-296c4ed7-ad83-4925-8813-371510882c8b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:56.928762 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-296c4ed7-ad83-4925-8813-371510882c8b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:56.929236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-296c4ed7-ad83-4925-8813-371510882c8b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:56.929655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-296c4ed7-ad83-4925-8813-371510882c8b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:56.930355 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-296c4ed7-ad83-4925-8813-371510882c8b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:56.930795 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-296c4ed7-ad83-4925-8813-371510882c8b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:56.931240 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-296c4ed7-ad83-4925-8813-371510882c8b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:57.087541 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-296c4ed7-ad83-4925-8813-371510882c8b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:57.102933 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-296c4ed7-ad83-4925-8813-371510882c8b tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1674 microversion: 2.1 time: 0.186338 Aug 08 13:44:57.103965 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 422/850] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:44:56 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:44:58.142948 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1654d29d-db02-4afc-bc6a-776ed29e0284 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:58.143903 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1654d29d-db02-4afc-bc6a-776ed29e0284 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:58.152052 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1654d29d-db02-4afc-bc6a-776ed29e0284 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:58.152784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1654d29d-db02-4afc-bc6a-776ed29e0284 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:58.153448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1654d29d-db02-4afc-bc6a-776ed29e0284 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:58.154726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1654d29d-db02-4afc-bc6a-776ed29e0284 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:58.155548 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1654d29d-db02-4afc-bc6a-776ed29e0284 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:58.156268 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1654d29d-db02-4afc-bc6a-776ed29e0284 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:58.415637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-1654d29d-db02-4afc-bc6a-776ed29e0284 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:58.425176 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1654d29d-db02-4afc-bc6a-776ed29e0284 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1674 microversion: 2.1 time: 0.288296 Aug 08 13:44:58.426140 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 429/851] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:44:58 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1674 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:44:58.976493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-b10aec3f-df24-45c0-a854-76c526bddef4 req-0a0c9b08-70fc-4a74-ba96-fa9c71f0376a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfd4416-ef05-480e-991b-2f18443ac75b", "name": "network-vif-deleted", "tag": "82fb36fd-bb54-407c-bbc3-960cd251607d"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:44:58.990322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-b10aec3f-df24-45c0-a854-76c526bddef4 req-0a0c9b08-70fc-4a74-ba96-fa9c71f0376a service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:58.990899 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-b10aec3f-df24-45c0-a854-76c526bddef4 req-0a0c9b08-70fc-4a74-ba96-fa9c71f0376a service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:58.991788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-b10aec3f-df24-45c0-a854-76c526bddef4 req-0a0c9b08-70fc-4a74-ba96-fa9c71f0376a service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:59.008984 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-b10aec3f-df24-45c0-a854-76c526bddef4 req-0a0c9b08-70fc-4a74-ba96-fa9c71f0376a service nova] Creating event network-vif-deleted:82fb36fd-bb54-407c-bbc3-960cd251607d for instance 9dfd4416-ef05-480e-991b-2f18443ac75b on hv-cinder-85199 Aug 08 13:44:59.017658 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-b10aec3f-df24-45c0-a854-76c526bddef4 req-0a0c9b08-70fc-4a74-ba96-fa9c71f0376a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049008 Aug 08 13:44:59.023137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 423/852] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:44:59.462669 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:44:59.463736 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:44:59.479710 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:59.481698 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:59.482673 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:59.484672 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:59.485857 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:59.486808 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:59.577445 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:44:59.578168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:44:59.578711 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:44:59.579275 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lazy-loading 'fault' on Instance uuid 9dfd4416-ef05-480e-991b-2f18443ac75b {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:44:59.633612 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651659e941044454985b2f866b791b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643240773a5840d3af2622469d696beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:44:59.643205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-dbcec4de-ed17-4958-8828-61c85e045acb tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 200 len: 1328 microversion: 2.1 time: 0.187805 Aug 08 13:44:59.644191 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 430/853] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:44:59 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 1328 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:00.670850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:00.671667 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:00.673947 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:45:00.679647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:00.680168 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:00.680646 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:00.681364 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:00.681814 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:00.682246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:00.699267 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] HTTP exception thrown: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Request method failure captured: Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b HTTP/1.1 Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REiAjcTAJC8QYW7CuJxlzGS1oUHLw3a-fySBXCZLWAHn7MEXKmVns_D4s_KpcvZ5gxC87yAdtUJnc3yAuvu208DlniMDVSjHk1F6iWWCBqxsBg-xkhe6K4GjLvg2-FG-_yHlFUImwCUvOKlNqUo4H4DQ9a4dGYdMNd5gRDt3L7GgjY Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 643240773a5840d3af2622469d696beb Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:45:00.700999 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_643240773a5840d3af2622469d696beb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/643240773a5840d3af2622469d696beb"}]}] Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 643240773a5840d3af2622469d696beb Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: 651659e941044454985b2f866b791b07 Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:00.702694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '9dfd4416-ef05-480e-991b-2f18443ac75b'} Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:00.703721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:00.705467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:00.706849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Returning 404 to user: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:00.706849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-615e5c30-c9f7-429c-8ccf-7b3332df690c tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 404 len: 111 microversion: 2.1 time: 0.036896 Aug 08 13:45:00.706849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 424/854] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:00 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:00.715176 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1706e842-ec75-4be1-b014-15516b2fcc8e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '.version_select at 0x7f7d240b0c10>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:00.737967 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1706e842-ec75-4be1-b014-15516b2fcc8e tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010548059" status: 202 len: 0 microversion: 2.1 time: 0.027306 Aug 08 13:45:00.738676 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 431/855] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Aug 8 13:45:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010548059 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:45:03.793124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:03.793796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:03.801043 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:03.801532 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:03.801974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:03.802684 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:03.803176 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:03.803601 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:03.822763 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] HTTP exception thrown: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Request method failure captured: Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b HTTP/1.1 Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REiAjcTAJC8QYW7CuJxlzGS1oUHLw3a-fySBXCZLWAHn7MEXKmVns_D4s_KpcvZ5gxC87yAdtUJnc3yAuvu208DlniMDVSjHk1F6iWWCBqxsBg-xkhe6K4GjLvg2-FG-_yHlFUImwCUvOKlNqUo4H4DQ9a4dGYdMNd5gRDt3L7GgjY Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 643240773a5840d3af2622469d696beb Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:45:03.824370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_643240773a5840d3af2622469d696beb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/643240773a5840d3af2622469d696beb"}]}] Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 643240773a5840d3af2622469d696beb Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: 651659e941044454985b2f866b791b07 Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:03.826585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '9dfd4416-ef05-480e-991b-2f18443ac75b'} Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:03.827961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:03.830201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:03.832406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Returning 404 to user: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:03.832406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-fae5e96d-db7c-482d-9b40-165f5bb36815 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 404 len: 111 microversion: 2.1 time: 0.038306 Aug 08 13:45:03.832406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 425/856] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:45:03 2022] DELETE /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:03.838620 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:03.839288 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 9dfd4416-ef05-480e-991b-2f18443ac75b] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:03.846545 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:03.847183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:03.847628 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:03.848426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:03.848812 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:03.849242 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:03.864395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] HTTP exception thrown: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Request method failure captured: Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b HTTP/1.1 Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REiAjcTAJC8QYW7CuJxlzGS1oUHLw3a-fySBXCZLWAHn7MEXKmVns_D4s_KpcvZ5gxC87yAdtUJnc3yAuvu208DlniMDVSjHk1F6iWWCBqxsBg-xkhe6K4GjLvg2-FG-_yHlFUImwCUvOKlNqUo4H4DQ9a4dGYdMNd5gRDt3L7GgjY Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 643240773a5840d3af2622469d696beb Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:45:03.866079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_643240773a5840d3af2622469d696beb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/643240773a5840d3af2622469d696beb"}]}] Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 643240773a5840d3af2622469d696beb Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: 651659e941044454985b2f866b791b07 Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:03.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '9dfd4416-ef05-480e-991b-2f18443ac75b'} Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:03.868478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. Aug 08 13:45:03.869929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:03.871235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Returning 404 to user: Instance 9dfd4416-ef05-480e-991b-2f18443ac75b could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:03.871235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f7a72c72-2054-49aa-82ff-193f02ddc5ad tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b" status: 404 len: 111 microversion: 2.1 time: 0.033504 Aug 08 13:45:03.871235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 432/857] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:03 2022] GET /compute/v2.1/servers/9dfd4416-ef05-480e-991b-2f18443ac75b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:05.050749 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:05.051393 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:05.058550 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:05.059050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:05.059522 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:05.060265 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:05.060711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:05.061145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:05.076349 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] HTTP exception thrown: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Request method failure captured: Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 HTTP/1.1 Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REiAjcTAJC8QYW7CuJxlzGS1oUHLw3a-fySBXCZLWAHn7MEXKmVns_D4s_KpcvZ5gxC87yAdtUJnc3yAuvu208DlniMDVSjHk1F6iWWCBqxsBg-xkhe6K4GjLvg2-FG-_yHlFUImwCUvOKlNqUo4H4DQ9a4dGYdMNd5gRDt3L7GgjY Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 643240773a5840d3af2622469d696beb Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:45:05.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_643240773a5840d3af2622469d696beb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/643240773a5840d3af2622469d696beb"}]}] Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 643240773a5840d3af2622469d696beb Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: 651659e941044454985b2f866b791b07 Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:45:05.080761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '3195b877-5ac0-4c2f-94b0-6afebf0a0ad9'} Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:05.081833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:45:05.084145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:05.086692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Returning 404 to user: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:05.086692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0ee532d1-f932-48f0-b557-c68f775946aa tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 404 len: 111 microversion: 2.1 time: 0.032884 Aug 08 13:45:05.086692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 426/858] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:45:05 2022] DELETE /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:05.095148 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:05.096206 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] [instance: 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:05.107832 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:05.108703 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:05.109446 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:05.110731 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:05.111581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:05.112316 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:05.135674 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] HTTP exception thrown: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Request method failure captured: Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 HTTP/1.1 Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REiAjcTAJC8QYW7CuJxlzGS1oUHLw3a-fySBXCZLWAHn7MEXKmVns_D4s_KpcvZ5gxC87yAdtUJnc3yAuvu208DlniMDVSjHk1F6iWWCBqxsBg-xkhe6K4GjLvg2-FG-_yHlFUImwCUvOKlNqUo4H4DQ9a4dGYdMNd5gRDt3L7GgjY Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 643240773a5840d3af2622469d696beb Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:45:05.137338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_643240773a5840d3af2622469d696beb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/643240773a5840d3af2622469d696beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/643240773a5840d3af2622469d696beb"}]}] Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 643240773a5840d3af2622469d696beb Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582210352 Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: 651659e941044454985b2f866b791b07 Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeTestJSON-582210352-project Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:45:05.138965 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '3195b877-5ac0-4c2f-94b0-6afebf0a0ad9'} Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:05.139888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. Aug 08 13:45:05.141485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:05.142798 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] Returning 404 to user: Instance 3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:05.142798 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-57afbde3-a117-43bc-863a-5c0b04d03f13 tempest-AttachVolumeTestJSON-582210352 tempest-AttachVolumeTestJSON-582210352-project] 10.222.0.33 "GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9" status: 404 len: 111 microversion: 2.1 time: 0.051439 Aug 08 13:45:05.144218 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 433/859] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:05 2022] GET /compute/v2.1/servers/3195b877-5ac0-4c2f-94b0-6afebf0a0ad9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:12.022249 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fabb1a47-edbd-43dd-8ce1-9b8999a1a3f6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:12.022921 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-fabb1a47-edbd-43dd-8ce1-9b8999a1a3f6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:12.030143 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fabb1a47-edbd-43dd-8ce1-9b8999a1a3f6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:12.030628 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fabb1a47-edbd-43dd-8ce1-9b8999a1a3f6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:12.031055 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fabb1a47-edbd-43dd-8ce1-9b8999a1a3f6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:12.031800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fabb1a47-edbd-43dd-8ce1-9b8999a1a3f6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:12.032250 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fabb1a47-edbd-43dd-8ce1-9b8999a1a3f6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:12.032693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fabb1a47-edbd-43dd-8ce1-9b8999a1a3f6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:12.058543 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-fabb1a47-edbd-43dd-8ce1-9b8999a1a3f6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/ips" status: 200 len: 148 microversion: 2.1 time: 0.040294 Aug 08 13:45:12.059174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 427/860] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 13:45:12 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:12.163331 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-902c7198-0b4e-4c4b-97cd-df02006bed57 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d240ba040>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:12.426428 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-902c7198-0b4e-4c4b-97cd-df02006bed57 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c91199e2-934d-4370-802e-eedf889bca3e" status: 200 len: 350 microversion: 2.1 time: 0.266949 Aug 08 13:45:12.427100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 434/861] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:45:12 2022] GET /compute/v2.1/os-volumes/c91199e2-934d-4370-802e-eedf889bca3e => generated 350 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:45:13.483135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-82190472-6795-438a-abb1-e8733cff8add tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a324856-9301-41fd-ba75-c52c759648ad"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:45:13.485517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-82190472-6795-438a-abb1-e8733cff8add tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:13.492986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82190472-6795-438a-abb1-e8733cff8add tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:13.493480 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82190472-6795-438a-abb1-e8733cff8add tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:13.493910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82190472-6795-438a-abb1-e8733cff8add tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:13.494614 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82190472-6795-438a-abb1-e8733cff8add tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:13.495103 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82190472-6795-438a-abb1-e8733cff8add tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:13.495566 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-82190472-6795-438a-abb1-e8733cff8add tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:13.818094 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0163d89a-1af9-411b-8715-06d1560c8719 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d2419c8b0>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:13.870836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-82190472-6795-438a-abb1-e8733cff8add tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "POST /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391538 Aug 08 13:45:13.871775 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 428/862] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:45:13 2022] POST /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:13.880231 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0163d89a-1af9-411b-8715-06d1560c8719 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/e4f69e94-b973-4948-a1cf-ada36ce38620" status: 200 len: 351 microversion: 2.1 time: 0.066582 Aug 08 13:45:13.881057 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 435/863] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:45:13 2022] GET /compute/v2.1/os-volumes/e4f69e94-b973-4948-a1cf-ada36ce38620 => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:45:15.318748 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d0389bc6-61bc-49a3-ae39-1cf76cc4eefc tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d241b6790>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:15.370482 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d0389bc6-61bc-49a3-ae39-1cf76cc4eefc tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/27efe791-3894-4515-b2f4-5ace1bc1a51f" status: 200 len: 350 microversion: 2.1 time: 0.056543 Aug 08 13:45:15.371237 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 429/864] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 13:45:15 2022] GET /compute/v2.1/os-volumes/27efe791-3894-4515-b2f4-5ace1bc1a51f => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:15.382032 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:45:15.382798 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:45:15.387954 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-88a2bc09-6a4d-4960-8f73-4155e3a76e9f tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d240c09d0>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:15.475768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-88a2bc09-6a4d-4960-8f73-4155e3a76e9f tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095090 Aug 08 13:45:15.476340 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 436/865] 10.222.0.33 () {58 vars in 1134 bytes} [Mon Aug 8 13:45:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:15.494607 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-dfd4c624-2c84-4f1c-9eff-a1aeb7c7cacd tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d240dbc10>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:15.584222 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-dfd4c624-2c84-4f1c-9eff-a1aeb7c7cacd tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093386 Aug 08 13:45:15.584815 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 430/866] 10.222.0.33 () {58 vars in 1149 bytes} [Mon Aug 8 13:45:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:15.600707 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a624f75d-2c12-406a-b0c5-1c8709377435 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d240ba9d0>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:15.683894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a624f75d-2c12-406a-b0c5-1c8709377435 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086974 Aug 08 13:45:15.684615 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 437/867] 10.222.0.33 () {58 vars in 1134 bytes} [Mon Aug 8 13:45:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:15.698088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-94b1b4c9-c9fe-419c-aec8-4f6d513c8465 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d240dbaf0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:15.785701 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-94b1b4c9-c9fe-419c-aec8-4f6d513c8465 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091411 Aug 08 13:45:15.786300 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 431/868] 10.222.0.33 () {58 vars in 1167 bytes} [Mon Aug 8 13:45:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:15.802491 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-54a7ee8c-c8b9-40d1-b076-4d6c4f6b7931 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d240535e0>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:15.888001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-54a7ee8c-c8b9-40d1-b076-4d6c4f6b7931 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089473 Aug 08 13:45:15.888657 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 438/869] 10.222.0.33 () {58 vars in 1170 bytes} [Mon Aug 8 13:45:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:15.905687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3a8cd2bb-c42f-4ff6-b7da-ab34af377e2e tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d2417fe50>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:15.988626 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3a8cd2bb-c42f-4ff6-b7da-ab34af377e2e tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086824 Aug 08 13:45:15.989194 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 432/870] 10.222.0.33 () {58 vars in 1155 bytes} [Mon Aug 8 13:45:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:16.002318 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-47d07213-d4f8-41a9-84b0-6c99938302d7 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d241090d0>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:16.108922 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-47d07213-d4f8-41a9-84b0-6c99938302d7 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.110517 Aug 08 13:45:16.109534 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 439/871] 10.222.0.33 () {58 vars in 1188 bytes} [Mon Aug 8 13:45:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:16.123437 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4d92161d-4a2b-4851-85b9-78a239914e56 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] Calling method '.version_select at 0x7f7d240e0670>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:16.211560 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4d92161d-4a2b-4851-85b9-78a239914e56 tempest-VolumesTestJSON-721116257 tempest-VolumesTestJSON-721116257-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.092316 Aug 08 13:45:16.212139 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 433/872] 10.222.0.33 () {58 vars in 1155 bytes} [Mon Aug 8 13:45:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:21.662634 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d37a842d-4001-42a9-87b0-7d4ee374696b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:21.662634 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d37a842d-4001-42a9-87b0-7d4ee374696b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:21.667497 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37a842d-4001-42a9-87b0-7d4ee374696b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:21.667984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37a842d-4001-42a9-87b0-7d4ee374696b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:21.668391 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37a842d-4001-42a9-87b0-7d4ee374696b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:21.669101 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37a842d-4001-42a9-87b0-7d4ee374696b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:21.669737 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37a842d-4001-42a9-87b0-7d4ee374696b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:21.670172 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37a842d-4001-42a9-87b0-7d4ee374696b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:21.763211 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-d37a842d-4001-42a9-87b0-7d4ee374696b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lazy-loading 'services' on Instance uuid 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:45:21.840030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d37a842d-4001-42a9-87b0-7d4ee374696b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/os-volume_attachments/2a324856-9301-41fd-ba75-c52c759648ad" status: 202 len: 0 microversion: 2.1 time: 0.184678 Aug 08 13:45:21.841029 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 440/873] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:45:21 2022] DELETE /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/os-volume_attachments/2a324856-9301-41fd-ba75-c52c759648ad => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:45:21.858337 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-19b6aeba-f9dd-4518-8bfc-7b960377c9ed tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:21.862333 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-19b6aeba-f9dd-4518-8bfc-7b960377c9ed tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:21.870861 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19b6aeba-f9dd-4518-8bfc-7b960377c9ed tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:21.871511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19b6aeba-f9dd-4518-8bfc-7b960377c9ed tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:21.871941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19b6aeba-f9dd-4518-8bfc-7b960377c9ed tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:21.872694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19b6aeba-f9dd-4518-8bfc-7b960377c9ed tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:21.873205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19b6aeba-f9dd-4518-8bfc-7b960377c9ed tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:21.873688 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-19b6aeba-f9dd-4518-8bfc-7b960377c9ed tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:21.909250 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-19b6aeba-f9dd-4518-8bfc-7b960377c9ed tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063010 Aug 08 13:45:21.914140 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 434/874] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:45:21 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:22.924884 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-390e156e-81cf-4a5f-896b-c23a296f53f8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:22.929334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-390e156e-81cf-4a5f-896b-c23a296f53f8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:22.938897 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390e156e-81cf-4a5f-896b-c23a296f53f8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:22.939627 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390e156e-81cf-4a5f-896b-c23a296f53f8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:22.940195 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390e156e-81cf-4a5f-896b-c23a296f53f8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:22.941079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390e156e-81cf-4a5f-896b-c23a296f53f8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:22.941562 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390e156e-81cf-4a5f-896b-c23a296f53f8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:22.943020 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-390e156e-81cf-4a5f-896b-c23a296f53f8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:22.991017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-390e156e-81cf-4a5f-896b-c23a296f53f8 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072012 Aug 08 13:45:22.992423 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 441/875] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:45:22 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 13:45:23.078225 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-146589fa-5eb4-4398-901a-725c1e4ed201 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:23.078225 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-146589fa-5eb4-4398-901a-725c1e4ed201 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:23.086278 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-146589fa-5eb4-4398-901a-725c1e4ed201 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:23.086278 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-146589fa-5eb4-4398-901a-725c1e4ed201 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:23.086278 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-146589fa-5eb4-4398-901a-725c1e4ed201 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:23.086278 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-146589fa-5eb4-4398-901a-725c1e4ed201 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:23.086713 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-146589fa-5eb4-4398-901a-725c1e4ed201 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:23.086804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-146589fa-5eb4-4398-901a-725c1e4ed201 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:23.128281 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-146589fa-5eb4-4398-901a-725c1e4ed201 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:45:23.218442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-146589fa-5eb4-4398-901a-725c1e4ed201 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 204 len: 0 microversion: 2.1 time: 0.147067 Aug 08 13:45:23.224255 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 435/876] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:45:23 2022] DELETE /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:45:23.230521 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5b45c6c0-34f9-4ada-9972-be8459ad99af tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:23.231496 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-5b45c6c0-34f9-4ada-9972-be8459ad99af tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:23.238806 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5b45c6c0-34f9-4ada-9972-be8459ad99af tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:23.239429 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5b45c6c0-34f9-4ada-9972-be8459ad99af tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:23.239947 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5b45c6c0-34f9-4ada-9972-be8459ad99af tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:23.240773 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5b45c6c0-34f9-4ada-9972-be8459ad99af tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:23.241572 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5b45c6c0-34f9-4ada-9972-be8459ad99af tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:23.242064 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5b45c6c0-34f9-4ada-9972-be8459ad99af tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:23.406580 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-5b45c6c0-34f9-4ada-9972-be8459ad99af tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:23.417501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-5b45c6c0-34f9-4ada-9972-be8459ad99af tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1679 microversion: 2.1 time: 0.190696 Aug 08 13:45:23.431110 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 442/877] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:23 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:24.443034 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-60132266-fd3f-4c0f-8556-74de01a3e458 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:24.443835 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-60132266-fd3f-4c0f-8556-74de01a3e458 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:24.450916 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60132266-fd3f-4c0f-8556-74de01a3e458 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:24.451282 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60132266-fd3f-4c0f-8556-74de01a3e458 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:24.451717 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60132266-fd3f-4c0f-8556-74de01a3e458 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:24.452420 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60132266-fd3f-4c0f-8556-74de01a3e458 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:24.452883 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60132266-fd3f-4c0f-8556-74de01a3e458 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:24.453328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-60132266-fd3f-4c0f-8556-74de01a3e458 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:24.613825 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-60132266-fd3f-4c0f-8556-74de01a3e458 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:24.622125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-60132266-fd3f-4c0f-8556-74de01a3e458 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1679 microversion: 2.1 time: 0.183335 Aug 08 13:45:24.622912 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 436/878] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:24 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:45:25.645539 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2620e469-69f9-4e8b-9174-3a0c626179ff tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:25.646151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2620e469-69f9-4e8b-9174-3a0c626179ff tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:25.653304 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2620e469-69f9-4e8b-9174-3a0c626179ff tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:25.653762 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2620e469-69f9-4e8b-9174-3a0c626179ff tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:25.654437 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2620e469-69f9-4e8b-9174-3a0c626179ff tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:25.655406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2620e469-69f9-4e8b-9174-3a0c626179ff tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:25.656043 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2620e469-69f9-4e8b-9174-3a0c626179ff tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:25.656506 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2620e469-69f9-4e8b-9174-3a0c626179ff tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:25.937429 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2620e469-69f9-4e8b-9174-3a0c626179ff tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:25.946606 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2620e469-69f9-4e8b-9174-3a0c626179ff tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1679 microversion: 2.1 time: 0.305095 Aug 08 13:45:25.948071 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 443/879] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:25 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1679 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:26.526898 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-abfd6da0-450e-4453-b6fd-e45d262a89c3 req-80593aec-f5e5-4cfd-962e-d8b34ce5c0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0", "name": "network-vif-deleted", "tag": "d4f999a9-9136-4564-a976-1c55da0fc8e7"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:45:26.552643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-abfd6da0-450e-4453-b6fd-e45d262a89c3 req-80593aec-f5e5-4cfd-962e-d8b34ce5c0e5 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:26.553288 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-abfd6da0-450e-4453-b6fd-e45d262a89c3 req-80593aec-f5e5-4cfd-962e-d8b34ce5c0e5 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:26.553829 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-abfd6da0-450e-4453-b6fd-e45d262a89c3 req-80593aec-f5e5-4cfd-962e-d8b34ce5c0e5 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:26.572602 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:45:26.578115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-abfd6da0-450e-4453-b6fd-e45d262a89c3 req-80593aec-f5e5-4cfd-962e-d8b34ce5c0e5 service nova] Creating event network-vif-deleted:d4f999a9-9136-4564-a976-1c55da0fc8e7 for instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 on hv-cinder-85199 Aug 08 13:45:26.588956 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-abfd6da0-450e-4453-b6fd-e45d262a89c3 req-80593aec-f5e5-4cfd-962e-d8b34ce5c0e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071008 Aug 08 13:45:26.590445 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 437/880] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:26.971061 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:26.971680 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:26.978954 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:26.979755 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:26.980198 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:26.981094 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:26.981775 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:26.982198 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:27.020052 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:27.020551 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:27.020987 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:27.021629 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lazy-loading 'fault' on Instance uuid 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:45:27.096357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce6a7d7dbc94adeb0b03bae34e335a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4293ff5f2cad4c399d03a89f4bc627f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:27.107629 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0360a048-c9bf-44b3-a8b4-82d3771475db tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 200 len: 1331 microversion: 2.1 time: 0.139587 Aug 08 13:45:27.108717 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 444/881] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:26 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:28.131946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:28.132990 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:28.142740 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:28.143269 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:28.143702 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:28.144422 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:28.144874 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:28.145295 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:28.163126 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 HTTP/1.1 Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:45:28.164850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:28.166546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0'} Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:28.167518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:28.169061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:28.170813 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:28.170813 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f9df06e3-f8f5-42fd-b242-ba2022e8361f tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 404 len: 111 microversion: 2.1 time: 0.038972 Aug 08 13:45:28.170813 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 438/882] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:28 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:28.176979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8f4509dd-31ee-4db6-b15e-d50cf5677dfa tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '.version_select at 0x7f7d240b0670>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:28.212007 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8f4509dd-31ee-4db6-b15e-d50cf5677dfa tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-217008974" status: 202 len: 0 microversion: 2.1 time: 0.040382 Aug 08 13:45:28.215678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 445/883] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Aug 8 13:45:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-217008974 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 13:45:30.183922 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:30.185141 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:30.201165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:30.201640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:30.202064 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:30.202768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:30.203276 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:30.203691 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:30.221406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 HTTP/1.1 Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:45:30.223203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:30.225443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0'} Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:30.230639 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:30.232162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:30.233566 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:30.233566 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-fb4a1959-1e2a-4e7e-854a-1ab339d4270b tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 404 len: 111 microversion: 2.1 time: 0.046453 Aug 08 13:45:30.233566 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 439/884] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:45:30 2022] DELETE /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 13:45:30.240814 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:30.241432 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:30.251792 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:30.252275 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:30.252705 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:30.253399 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:30.253880 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:30.254383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:30.268299 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 HTTP/1.1 Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:45:30.269996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:30.273222 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0'} Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:30.274624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. Aug 08 13:45:30.276826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:30.278307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:30.278307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-219a4c1f-462f-43bf-8363-711b1b22fcba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0" status: 404 len: 111 microversion: 2.1 time: 0.036376 Aug 08 13:45:30.278307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 446/885] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:30 2022] GET /compute/v2.1/servers/3a7f1e89-1fc9-49ff-9e08-7ce1df5453b0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:31.438887 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:31.441058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:31.450280 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:45:31.457189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:31.458030 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:31.458892 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:31.460190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:31.460995 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:31.461728 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:31.491378 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 HTTP/1.1 Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:45:31.494552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:45:31.496110 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '16e355ee-03af-44f5-b661-405530019c73'} Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:31.496911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:45:31.498569 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.500073 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:31.500073 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c754064e-9c93-4373-be4c-0272c32c99ba tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 404 len: 111 microversion: 2.1 time: 0.068398 Aug 08 13:45:31.500073 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 440/886] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:45:31 2022] DELETE /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 13:45:31.507049 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:31.508091 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 16e355ee-03af-44f5-b661-405530019c73] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:31.517743 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:31.518535 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:31.519437 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:31.520777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:31.521901 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:31.522818 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:31.547339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 HTTP/1.1 Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:45:31.550111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:45:31.552920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '16e355ee-03af-44f5-b661-405530019c73'} Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:31.554532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. Aug 08 13:45:31.557182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.563960 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 16e355ee-03af-44f5-b661-405530019c73 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:31.563960 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ca20e306-fc18-4729-a1a2-de6ccd891d96 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73" status: 404 len: 111 microversion: 2.1 time: 0.059792 Aug 08 13:45:31.564505 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 447/887] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:31 2022] GET /compute/v2.1/servers/16e355ee-03af-44f5-b661-405530019c73 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:31.575592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:31.576579 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:31.587763 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:31.588653 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:31.589462 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:31.590720 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:31.591563 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:31.592557 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:31.621850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce HTTP/1.1 Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:45:31.625552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:45:31.628165 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '80d56005-2c47-4e78-88a8-1e70921411ce'} Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:31.629611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:45:31.632097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.634605 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:31.634605 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a3323b56-7a62-4bbd-bfda-9f15715128ef tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 404 len: 111 microversion: 2.1 time: 0.065630 Aug 08 13:45:31.639935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 441/888] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:45:31 2022] DELETE /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 13:45:31.647469 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:31.648163 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 80d56005-2c47-4e78-88a8-1e70921411ce] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:31.659503 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:31.660525 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:31.660970 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:31.662126 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:31.662630 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:31.663615 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:31.687861 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce HTTP/1.1 Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:45:31.690877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:45:31.692518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '80d56005-2c47-4e78-88a8-1e70921411ce'} Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:31.693414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. Aug 08 13:45:31.694886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:31.696076 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 80d56005-2c47-4e78-88a8-1e70921411ce could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:31.696076 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2e011200-25b5-48d0-a49a-28e974198bd6 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce" status: 404 len: 111 microversion: 2.1 time: 0.051462 Aug 08 13:45:31.696076 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 448/889] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:31 2022] GET /compute/v2.1/servers/80d56005-2c47-4e78-88a8-1e70921411ce => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:32.925519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:32.926390 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:32.938406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:32.939520 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:32.940204 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:32.941458 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:32.942284 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:32.942998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:32.970555 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 HTTP/1.1 Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:45:32.973726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:45:32.975244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '11502875-0366-4e45-876a-43cbc50f7261'} Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:32.976035 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:45:32.978202 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:32.979647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:32.979647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9b6db40e-8778-4952-937e-5eca60f3293e tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "DELETE /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 404 len: 111 microversion: 2.1 time: 0.058335 Aug 08 13:45:32.979647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 442/890] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:45:32 2022] DELETE /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:32.985877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:32.986789 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] [instance: 11502875-0366-4e45-876a-43cbc50f7261] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:32.994307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:32.994802 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:32.995272 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:32.996011 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:32.996474 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:32.996895 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:33.016654 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] HTTP exception thrown: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Request method failure captured: Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 HTTP/1.1 Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REadVqS-wm537zIgTf9h3STKvXbqoc3A2_XQlx8leTjmJBBZcZ4PsSbwUuLHzceVaqdrAU_wbOQCYgzbVPi26D1ztIRUC4v99aBgX9QFh7agHviZMIsN-tNse9Rfs8hxxrmWusyLnunU6lJFp3YpHQotniPWUtZS7PLuPU7DJ58n6s Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:45:33.019408 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4293ff5f2cad4c399d03a89f4bc627f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4293ff5f2cad4c399d03a89f4bc627f5"}]}] Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 4293ff5f2cad4c399d03a89f4bc627f5 Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715287346 Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: fce6a7d7dbc94adeb0b03bae34e335a0 Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeNegativeTest-715287346-project Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:45:33.020894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '11502875-0366-4e45-876a-43cbc50f7261'} Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:33.021699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. Aug 08 13:45:33.023059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:33.025686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] Returning 404 to user: Instance 11502875-0366-4e45-876a-43cbc50f7261 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:33.025686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6ebdcf33-5e87-42e9-9f61-a64f535eeda2 tempest-AttachVolumeNegativeTest-715287346 tempest-AttachVolumeNegativeTest-715287346-project] 10.222.0.33 "GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261" status: 404 len: 111 microversion: 2.1 time: 0.040092 Aug 08 13:45:33.027821 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 449/891] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:32 2022] GET /compute/v2.1/servers/11502875-0366-4e45-876a-43cbc50f7261 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:45:48.991476 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-27a367d1-2966-4cfd-80b8-e975fa583463 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:48.996479 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-27a367d1-2966-4cfd-80b8-e975fa583463 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:49.007507 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:45:49.008628 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=11 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:45:49.010797 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27a367d1-2966-4cfd-80b8-e975fa583463 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:49.011922 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27a367d1-2966-4cfd-80b8-e975fa583463 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:49.012953 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27a367d1-2966-4cfd-80b8-e975fa583463 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:49.014435 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27a367d1-2966-4cfd-80b8-e975fa583463 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:49.015300 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27a367d1-2966-4cfd-80b8-e975fa583463 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:49.016317 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27a367d1-2966-4cfd-80b8-e975fa583463 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:49.081069 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-27a367d1-2966-4cfd-80b8-e975fa583463 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.092542 Aug 08 13:45:49.085547 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 443/892] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Aug 8 13:45:48 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:49.184020 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b4dc969a-e1f9-45bd-b5be-0bc0aa951f98 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:49.185226 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b4dc969a-e1f9-45bd-b5be-0bc0aa951f98 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:49.198267 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:45:49.199022 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:45:49.202754 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4dc969a-e1f9-45bd-b5be-0bc0aa951f98 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:49.203330 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4dc969a-e1f9-45bd-b5be-0bc0aa951f98 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:49.203966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4dc969a-e1f9-45bd-b5be-0bc0aa951f98 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:49.204456 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4dc969a-e1f9-45bd-b5be-0bc0aa951f98 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:49.204895 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4dc969a-e1f9-45bd-b5be-0bc0aa951f98 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:49.205320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b4dc969a-e1f9-45bd-b5be-0bc0aa951f98 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:49.248064 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b4dc969a-e1f9-45bd-b5be-0bc0aa951f98 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Going to try to terminate instance {{(pid=124408) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:45:49.361901 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b4dc969a-e1f9-45bd-b5be-0bc0aa951f98 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 204 len: 0 microversion: 2.20 time: 0.181675 Aug 08 13:45:49.362496 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 450/893] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Aug 8 13:45:49 2022] DELETE /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 13:45:49.387945 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:49.391498 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:49.398865 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:49.399383 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:49.400038 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:49.400618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:49.401065 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:49.401726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:49.576590 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:49.588293 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:49.589911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:49.591373 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-62cb031f-f60e-4b5c-b1f3-a469b97b66a6 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.221225 Aug 08 13:45:49.603561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 444/894] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:45:49 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:45:50.622461 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:50.623356 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:50.636859 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:50.637417 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:50.637908 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:50.638852 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:50.639447 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:50.640024 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:50.797517 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:50.811432 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:50.813267 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:50.814641 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-685e12da-f95a-4de6-837e-e3ae82fce0c5 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.199324 Aug 08 13:45:50.815428 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 451/895] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:45:50 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:45:51.842768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:51.843528 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:51.857642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:51.858396 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:51.862294 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:51.863296 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:51.864369 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:51.864793 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:52.121190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:52.137326 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:52.143819 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:52.174137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-00296fda-1009-4357-ae20-316a84799329 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1724 microversion: 2.20 time: 0.339073 Aug 08 13:45:52.190413 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 445/896] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:45:51 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:45:52.555181 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-8f211d64-9b9c-400a-a9d7-0926b2a5517f req-c7d5d365-480f-4a43-8e90-0bc708037dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f5ea81-40a9-4734-8c39-c5f0a2a55bab", "name": "network-vif-deleted", "tag": "5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:45:52.571980 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-8f211d64-9b9c-400a-a9d7-0926b2a5517f req-c7d5d365-480f-4a43-8e90-0bc708037dba service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:52.572790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-8f211d64-9b9c-400a-a9d7-0926b2a5517f req-c7d5d365-480f-4a43-8e90-0bc708037dba service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:52.573411 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-8f211d64-9b9c-400a-a9d7-0926b2a5517f req-c7d5d365-480f-4a43-8e90-0bc708037dba service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:52.848941 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-8f211d64-9b9c-400a-a9d7-0926b2a5517f req-c7d5d365-480f-4a43-8e90-0bc708037dba service nova] Creating event network-vif-deleted:5d80832d-4b44-41ca-8e1c-2f0d2b7f9dd5 for instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab on hv-cinder-85199 Aug 08 13:45:52.854725 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-8f211d64-9b9c-400a-a9d7-0926b2a5517f req-c7d5d365-480f-4a43-8e90-0bc708037dba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310157 Aug 08 13:45:52.855838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 452/897] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:53.208159 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:53.209804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:53.227962 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:53.229233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:53.229977 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:53.231612 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:53.232638 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:53.233646 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:53.297430 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:53.298523 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:53.300689 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:53.302188 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.objects.instance [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lazy-loading 'fault' on Instance uuid a7f5ea81-40a9-4734-8c39-c5f0a2a55bab {{(pid=124407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:45:53.365781 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:53.378745 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:53.384095 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c29ce05ebc6e4672bb9557f751a48557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0831512491044565b17fb6dd11a57b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:53.387828 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2ad2c43c-3432-412d-b3cf-6f0786e23b7e tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 200 len: 1371 microversion: 2.20 time: 0.190495 Aug 08 13:45:53.399109 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 446/898] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:45:53 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 13:45:53.885264 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7181daf2-0632-4282-8b4d-650d7d7d060a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Action: 'create', calling method: .version_select at 0x7f7d24074310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1085035743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpjtmBgY1M91wSuf+EJyT8ceyg9FaI34t+WzOHmM2EWywqG5uMZ8jAsDXzbkyIq7F7HrVydsbmz1VSG0l/BEKNilUnZ6MxthoLCE4fhZZI1lb5fc9O323BOsx4iSh25Dw=="}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:45:53.902243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-7181daf2-0632-4282-8b4d-650d7d7d060a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Getting quotas for project 554bfc93b1a44d57a5e8e5868cd2eed6. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:45:53.907056 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-7181daf2-0632-4282-8b4d-650d7d7d060a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Getting quotas for user 14aab8af2e6b4201b0951199de8156e8 and project 554bfc93b1a44d57a5e8e5868cd2eed6. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:45:53.930293 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7181daf2-0632-4282-8b4d-650d7d7d060a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049653 Aug 08 13:45:53.930904 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 453/899] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 13:45:53 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:53.987677 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2038305617", "imageRef": "6304b81e-4302-4d5a-9634-4eea9b2f3dd6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1085035743", "networks": [{"uuid": "154811ca-e0ae-4e26-b52f-607f3ef75a21"}]}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:45:54.047681 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] validate_networks() for [('154811ca-e0ae-4e26-b52f-607f3ef75a21', None, None, None, None, None)] {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:45:54.411682 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:54.412843 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:54.420740 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:54.421229 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:54.421665 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:54.422387 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:54.422846 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:54.423302 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:54.442289 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] HTTP exception thrown: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Request method failure captured: Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab HTTP/1.1 Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REwp3NUbGlTyrrSSR2kwvstDxKh2tvyYUeIgQMhnwePf76c5dETBdbR0XAAOPEaWdM0hn5un3rW598Y8UusbWV6OTrgazdOTk8QbGemf0qg1Pt17Qz0wPG8qsd8fuSusXfBwBqh2D6LvMaJvRxZ8q-rxcMauFnWlid5T0kdsFTmvMU Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:45:54.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0831512491044565b17fb6dd11a57b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0831512491044565b17fb6dd11a57b5f"}]}] Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: c29ce05ebc6e4672bb9557f751a48557 Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:54.445858 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': 'a7f5ea81-40a9-4734-8c39-c5f0a2a55bab'} Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:54.446918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:54.448462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:54.449956 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Returning 404 to user: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:54.449956 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6212bc96-0372-49bd-b7e2-32fb6a8f21cf tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 404 len: 111 microversion: 2.20 time: 0.038080 Aug 08 13:45:54.450185 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 454/900] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:45:54 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 08 13:45:54.455196 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a0a13c7b-cf83-41b7-81d8-40fbd1df4088 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '.version_select at 0x7f7d240b0dc0>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:54.476745 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a0a13c7b-cf83-41b7-81d8-40fbd1df4088 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725106841" status: 204 len: 0 microversion: 2.20 time: 0.025476 Aug 08 13:45:54.477369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 455/901] 10.222.0.33 () {60 vars in 1262 bytes} [Mon Aug 8 13:45:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725106841 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 13:45:54.493620 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:45:54.494150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:45:54.494499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:45:54.494905 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:45:54.495379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:45:54.505803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:54.506403 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:54.507059 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:54.508114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:54.508570 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:54.509209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:54.535196 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Getting quotas for project 554bfc93b1a44d57a5e8e5868cd2eed6. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:45:54.540320 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Getting quotas for user 14aab8af2e6b4201b0951199de8156e8 and project 554bfc93b1a44d57a5e8e5868cd2eed6. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:45:54.557541 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:45:54.559961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6304b81e-4302-4d5a-9634-4eea9b2f3dd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:45:54.611384 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-34567c61-75be-4e79-8c3e-dae6a2db2900 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627650 Aug 08 13:45:54.615302 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 447/902] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:45:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:45:54.624013 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-62bf878d-324b-4079-97af-7fc06dd2db7c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:54.624549 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-62bf878d-324b-4079-97af-7fc06dd2db7c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:54.723179 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-62bf878d-324b-4079-97af-7fc06dd2db7c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:54.737879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-62bf878d-324b-4079-97af-7fc06dd2db7c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1259 microversion: 2.1 time: 0.117844 Aug 08 13:45:54.738776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 456/903] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:54 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1259 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:55.763264 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a7ef980b-ee43-4889-8223-aa8d613c112b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:55.764402 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a7ef980b-ee43-4889-8223-aa8d613c112b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:55.776889 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a7ef980b-ee43-4889-8223-aa8d613c112b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:55.777894 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a7ef980b-ee43-4889-8223-aa8d613c112b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:55.778789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a7ef980b-ee43-4889-8223-aa8d613c112b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:55.780248 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a7ef980b-ee43-4889-8223-aa8d613c112b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:55.781082 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a7ef980b-ee43-4889-8223-aa8d613c112b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:55.781852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a7ef980b-ee43-4889-8223-aa8d613c112b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:55.905673 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a7ef980b-ee43-4889-8223-aa8d613c112b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:55.914608 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a7ef980b-ee43-4889-8223-aa8d613c112b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1319 microversion: 2.1 time: 0.158251 Aug 08 13:45:55.915231 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 448/904] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:55 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:56.401316 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:56.402199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:56.420917 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:56.421765 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:56.429124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:56.430836 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:56.431966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:56.432943 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:56.460382 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] HTTP exception thrown: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Request method failure captured: Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: DELETE /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab HTTP/1.1 Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REwp3NUbGlTyrrSSR2kwvstDxKh2tvyYUeIgQMhnwePf76c5dETBdbR0XAAOPEaWdM0hn5un3rW598Y8UusbWV6OTrgazdOTk8QbGemf0qg1Pt17Qz0wPG8qsd8fuSusXfBwBqh2D6LvMaJvRxZ8q-rxcMauFnWlid5T0kdsFTmvMU Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:45:56.464829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0831512491044565b17fb6dd11a57b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0831512491044565b17fb6dd11a57b5f"}]}] Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: c29ce05ebc6e4672bb9557f751a48557 Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:56.466476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': 'a7f5ea81-40a9-4734-8c39-c5f0a2a55bab'} Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:56.467441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:56.469605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:56.471345 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Returning 404 to user: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:56.471345 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a27c33aa-9be6-44c7-943e-d47d46f9ad93 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 404 len: 111 microversion: 2.20 time: 0.082393 Aug 08 13:45:56.481917 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:56.483190 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 457/905] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Aug 8 13:45:56 2022] DELETE /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 13:45:56.483736 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: a7f5ea81-40a9-4734-8c39-c5f0a2a55bab] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:56.494824 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:56.496171 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:56.497221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:56.498744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:56.499832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:56.500840 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:56.535509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] HTTP exception thrown: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Request method failure captured: Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab HTTP/1.1 Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REwp3NUbGlTyrrSSR2kwvstDxKh2tvyYUeIgQMhnwePf76c5dETBdbR0XAAOPEaWdM0hn5un3rW598Y8UusbWV6OTrgazdOTk8QbGemf0qg1Pt17Qz0wPG8qsd8fuSusXfBwBqh2D6LvMaJvRxZ8q-rxcMauFnWlid5T0kdsFTmvMU Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:45:56.539768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0831512491044565b17fb6dd11a57b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0831512491044565b17fb6dd11a57b5f"}]}] Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: c29ce05ebc6e4672bb9557f751a48557 Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:56.542760 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': 'a7f5ea81-40a9-4734-8c39-c5f0a2a55bab'} Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:56.547271 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. Aug 08 13:45:56.552406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:56.564339 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Returning 404 to user: Instance a7f5ea81-40a9-4734-8c39-c5f0a2a55bab could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:56.566053 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-883ff417-24fb-45da-ac71-55c05c0812bd tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab" status: 404 len: 111 microversion: 2.20 time: 0.090879 Aug 08 13:45:56.573069 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 449/906] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:45:56 2022] GET /compute/v2.1/servers/a7f5ea81-40a9-4734-8c39-c5f0a2a55bab => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 13:45:56.938873 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7915a08d-8c55-4c95-b899-7f7443f85ba1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:56.940091 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7915a08d-8c55-4c95-b899-7f7443f85ba1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:56.947814 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7915a08d-8c55-4c95-b899-7f7443f85ba1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:56.948539 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7915a08d-8c55-4c95-b899-7f7443f85ba1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:56.948931 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7915a08d-8c55-4c95-b899-7f7443f85ba1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:56.949667 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7915a08d-8c55-4c95-b899-7f7443f85ba1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:56.950139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7915a08d-8c55-4c95-b899-7f7443f85ba1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:56.950559 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7915a08d-8c55-4c95-b899-7f7443f85ba1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:57.276462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7915a08d-8c55-4c95-b899-7f7443f85ba1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:57.285805 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7915a08d-8c55-4c95-b899-7f7443f85ba1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.352628 Aug 08 13:45:57.303916 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 458/907] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:56 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:57.945801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:57.946463 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:57.961460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:57.962131 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:57.962862 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:57.963867 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:57.964682 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:57.965343 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:57.989263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] HTTP exception thrown: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Request method failure captured: Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c HTTP/1.1 Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8REwp3NUbGlTyrrSSR2kwvstDxKh2tvyYUeIgQMhnwePf76c5dETBdbR0XAAOPEaWdM0hn5un3rW598Y8UusbWV6OTrgazdOTk8QbGemf0qg1Pt17Qz0wPG8qsd8fuSusXfBwBqh2D6LvMaJvRxZ8q-rxcMauFnWlid5T0kdsFTmvMU Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:45:57.997695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0831512491044565b17fb6dd11a57b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0831512491044565b17fb6dd11a57b5f"}]}] Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: c29ce05ebc6e4672bb9557f751a48557 Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:45:58.000703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': 'b337a957-cd21-4f51-aa36-f64ad24aee7c'} Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:58.002262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:45:58.004796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:45:58.009036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Returning 404 to user: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:58.010840 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0983279e-7557-44b6-a69f-4b28a0bca1a9 tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 404 len: 111 microversion: 2.20 time: 0.068995 Aug 08 13:45:58.012018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 450/908] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Aug 8 13:45:57 2022] DELETE /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 08 13:45:58.020834 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:58.021772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] [instance: b337a957-cd21-4f51-aa36-f64ad24aee7c] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:58.029106 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:58.029761 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:58.030338 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:58.031201 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:58.031920 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:58.032460 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:58.052033 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] HTTP exception thrown: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Request method failure captured: Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c HTTP/1.1 Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8REwp3NUbGlTyrrSSR2kwvstDxKh2tvyYUeIgQMhnwePf76c5dETBdbR0XAAOPEaWdM0hn5un3rW598Y8UusbWV6OTrgazdOTk8QbGemf0qg1Pt17Qz0wPG8qsd8fuSusXfBwBqh2D6LvMaJvRxZ8q-rxcMauFnWlid5T0kdsFTmvMU Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:45:58.054670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0831512491044565b17fb6dd11a57b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0831512491044565b17fb6dd11a57b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0831512491044565b17fb6dd11a57b5f"}]}] Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 0831512491044565b17fb6dd11a57b5f Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2065310095 Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: c29ce05ebc6e4672bb9557f751a48557 Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2065310095-project Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:45:58.060845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': 'b337a957-cd21-4f51-aa36-f64ad24aee7c'} Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:45:58.063377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. Aug 08 13:45:58.064748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:45:58.066055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] Returning 404 to user: Instance b337a957-cd21-4f51-aa36-f64ad24aee7c could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:45:58.066055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-5c49e8f3-0187-479a-bf72-58b2237071ed tempest-AttachVolumeShelveTestJSON-2065310095 tempest-AttachVolumeShelveTestJSON-2065310095-project] 10.222.0.33 "GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c" status: 404 len: 111 microversion: 2.20 time: 0.040133 Aug 08 13:45:58.066055 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 459/909] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 13:45:58 2022] GET /compute/v2.1/servers/b337a957-cd21-4f51-aa36-f64ad24aee7c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 13:45:58.331335 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8335247b-db2d-4852-823f-b106c5203b1f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:58.341521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8335247b-db2d-4852-823f-b106c5203b1f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:58.370227 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8335247b-db2d-4852-823f-b106c5203b1f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:58.396484 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8335247b-db2d-4852-823f-b106c5203b1f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:58.397795 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8335247b-db2d-4852-823f-b106c5203b1f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:58.399495 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8335247b-db2d-4852-823f-b106c5203b1f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:58.400693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8335247b-db2d-4852-823f-b106c5203b1f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:58.401788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8335247b-db2d-4852-823f-b106c5203b1f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:58.855350 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8335247b-db2d-4852-823f-b106c5203b1f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:45:58.868539 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8335247b-db2d-4852-823f-b106c5203b1f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.559045 Aug 08 13:45:58.869962 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 451/910] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:58 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:45:58.977558 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-ee8cff12-5946-4171-8db8-202da097e78b req-b030179a-e3fc-4d63-8c2a-986bf8317f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6e39bb-b46d-411d-a8b7-d72aec249294", "tag": "45702b70-c19c-4c1e-9dba-aa467622e0fa"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:45:58.997669 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-ee8cff12-5946-4171-8db8-202da097e78b req-b030179a-e3fc-4d63-8c2a-986bf8317f65 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:58.998195 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-ee8cff12-5946-4171-8db8-202da097e78b req-b030179a-e3fc-4d63-8c2a-986bf8317f65 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:58.998614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-ee8cff12-5946-4171-8db8-202da097e78b req-b030179a-e3fc-4d63-8c2a-986bf8317f65 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:59.025546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-ee8cff12-5946-4171-8db8-202da097e78b req-b030179a-e3fc-4d63-8c2a-986bf8317f65 service nova] Creating event network-changed:45702b70-c19c-4c1e-9dba-aa467622e0fa for instance cd6e39bb-b46d-411d-a8b7-d72aec249294 on hv-cinder-85199 Aug 08 13:45:59.038946 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-ee8cff12-5946-4171-8db8-202da097e78b req-b030179a-e3fc-4d63-8c2a-986bf8317f65 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065488 Aug 08 13:45:59.040177 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 460/911] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:45:59.901249 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b85badf2-84ab-4f65-826c-6fc441a00843 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:45:59.902029 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b85badf2-84ab-4f65-826c-6fc441a00843 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:45:59.909618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b85badf2-84ab-4f65-826c-6fc441a00843 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:59.910205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b85badf2-84ab-4f65-826c-6fc441a00843 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:59.910642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b85badf2-84ab-4f65-826c-6fc441a00843 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:45:59.911584 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b85badf2-84ab-4f65-826c-6fc441a00843 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:45:59.912031 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b85badf2-84ab-4f65-826c-6fc441a00843 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:45:59.912458 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b85badf2-84ab-4f65-826c-6fc441a00843 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:00.128496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b85badf2-84ab-4f65-826c-6fc441a00843 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:00.144766 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b85badf2-84ab-4f65-826c-6fc441a00843 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.247086 Aug 08 13:46:00.146097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 452/912] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:45:59 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:01.171339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b36ff45b-2163-4014-a3de-ab5c21b86115 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:01.172712 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b36ff45b-2163-4014-a3de-ab5c21b86115 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:01.192492 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b36ff45b-2163-4014-a3de-ab5c21b86115 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:01.192984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b36ff45b-2163-4014-a3de-ab5c21b86115 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:01.193425 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b36ff45b-2163-4014-a3de-ab5c21b86115 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:01.194152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b36ff45b-2163-4014-a3de-ab5c21b86115 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:01.194655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b36ff45b-2163-4014-a3de-ab5c21b86115 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:01.195109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b36ff45b-2163-4014-a3de-ab5c21b86115 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:01.461546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b36ff45b-2163-4014-a3de-ab5c21b86115 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:01.471769 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b36ff45b-2163-4014-a3de-ab5c21b86115 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.306145 Aug 08 13:46:01.472854 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 461/913] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:01 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:02.552926 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ee712303-25ff-4cb6-9499-4b2972ba3e87 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:02.561624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ee712303-25ff-4cb6-9499-4b2972ba3e87 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:02.578335 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee712303-25ff-4cb6-9499-4b2972ba3e87 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:02.579301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee712303-25ff-4cb6-9499-4b2972ba3e87 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:02.581526 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee712303-25ff-4cb6-9499-4b2972ba3e87 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:02.582642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee712303-25ff-4cb6-9499-4b2972ba3e87 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:02.594334 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee712303-25ff-4cb6-9499-4b2972ba3e87 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:02.598562 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ee712303-25ff-4cb6-9499-4b2972ba3e87 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:03.090605 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ee712303-25ff-4cb6-9499-4b2972ba3e87 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:03.107741 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ee712303-25ff-4cb6-9499-4b2972ba3e87 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.589352 Aug 08 13:46:03.131133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 453/914] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:02 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:04.134592 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ab542580-f1c8-4f18-921e-8458b4fd0bfc tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:04.135317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ab542580-f1c8-4f18-921e-8458b4fd0bfc tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:04.144002 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab542580-f1c8-4f18-921e-8458b4fd0bfc tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:04.145037 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab542580-f1c8-4f18-921e-8458b4fd0bfc tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:04.145348 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab542580-f1c8-4f18-921e-8458b4fd0bfc tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:04.146250 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab542580-f1c8-4f18-921e-8458b4fd0bfc tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:04.146787 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab542580-f1c8-4f18-921e-8458b4fd0bfc tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:04.147546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab542580-f1c8-4f18-921e-8458b4fd0bfc tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:04.352099 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ab542580-f1c8-4f18-921e-8458b4fd0bfc tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:04.361034 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ab542580-f1c8-4f18-921e-8458b4fd0bfc tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.234559 Aug 08 13:46:04.362018 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 462/915] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:04 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:05.380960 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:05.382453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:05.388359 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-83f822ce-3a56-4cf7-97a2-73ea51ecd716 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:05.389079 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-83f822ce-3a56-4cf7-97a2-73ea51ecd716 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:05.396922 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83f822ce-3a56-4cf7-97a2-73ea51ecd716 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:05.397403 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83f822ce-3a56-4cf7-97a2-73ea51ecd716 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:05.397830 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83f822ce-3a56-4cf7-97a2-73ea51ecd716 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:05.398525 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83f822ce-3a56-4cf7-97a2-73ea51ecd716 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:05.398963 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83f822ce-3a56-4cf7-97a2-73ea51ecd716 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:05.399429 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-83f822ce-3a56-4cf7-97a2-73ea51ecd716 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:05.597654 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-83f822ce-3a56-4cf7-97a2-73ea51ecd716 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:05.607877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-83f822ce-3a56-4cf7-97a2-73ea51ecd716 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.228096 Aug 08 13:46:05.608911 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 454/916] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:05 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:06.629691 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e834ae71-ed93-49ff-91bf-bad74bffc6c6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:06.630288 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e834ae71-ed93-49ff-91bf-bad74bffc6c6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:06.632341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:06.639885 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e834ae71-ed93-49ff-91bf-bad74bffc6c6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:06.640450 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e834ae71-ed93-49ff-91bf-bad74bffc6c6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:06.640887 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e834ae71-ed93-49ff-91bf-bad74bffc6c6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:06.641642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e834ae71-ed93-49ff-91bf-bad74bffc6c6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:06.642091 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e834ae71-ed93-49ff-91bf-bad74bffc6c6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:06.642508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e834ae71-ed93-49ff-91bf-bad74bffc6c6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:06.818406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e834ae71-ed93-49ff-91bf-bad74bffc6c6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:06.826377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e834ae71-ed93-49ff-91bf-bad74bffc6c6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.200654 Aug 08 13:46:06.826949 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 463/917] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:06 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:46:07.848457 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e24f4f0f-b259-4921-823b-2bbaa17c0f4b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:07.849118 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e24f4f0f-b259-4921-823b-2bbaa17c0f4b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:07.856362 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e24f4f0f-b259-4921-823b-2bbaa17c0f4b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:07.856837 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e24f4f0f-b259-4921-823b-2bbaa17c0f4b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:07.857262 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e24f4f0f-b259-4921-823b-2bbaa17c0f4b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:07.857955 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e24f4f0f-b259-4921-823b-2bbaa17c0f4b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:07.858400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e24f4f0f-b259-4921-823b-2bbaa17c0f4b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:07.858792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e24f4f0f-b259-4921-823b-2bbaa17c0f4b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:08.013032 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e24f4f0f-b259-4921-823b-2bbaa17c0f4b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:08.021334 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e24f4f0f-b259-4921-823b-2bbaa17c0f4b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.177203 Aug 08 13:46:08.021925 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 455/918] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:07 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:09.042743 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7ecb39ce-8931-47e4-a04f-cd11eb0f578f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:09.043504 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7ecb39ce-8931-47e4-a04f-cd11eb0f578f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:09.051109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ecb39ce-8931-47e4-a04f-cd11eb0f578f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:09.051613 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ecb39ce-8931-47e4-a04f-cd11eb0f578f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:09.052050 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ecb39ce-8931-47e4-a04f-cd11eb0f578f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:09.052794 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ecb39ce-8931-47e4-a04f-cd11eb0f578f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:09.053253 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ecb39ce-8931-47e4-a04f-cd11eb0f578f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:09.053708 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7ecb39ce-8931-47e4-a04f-cd11eb0f578f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:09.221667 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7ecb39ce-8931-47e4-a04f-cd11eb0f578f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:09.229719 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7ecb39ce-8931-47e4-a04f-cd11eb0f578f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.190859 Aug 08 13:46:09.230300 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 464/919] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:09 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:10.251200 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e673a01d-9f5e-4c94-9666-4688d82ad99d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:10.251895 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e673a01d-9f5e-4c94-9666-4688d82ad99d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:10.259145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e673a01d-9f5e-4c94-9666-4688d82ad99d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:10.259744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e673a01d-9f5e-4c94-9666-4688d82ad99d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:10.260245 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e673a01d-9f5e-4c94-9666-4688d82ad99d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:10.261504 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e673a01d-9f5e-4c94-9666-4688d82ad99d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:10.261504 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e673a01d-9f5e-4c94-9666-4688d82ad99d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:10.262169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e673a01d-9f5e-4c94-9666-4688d82ad99d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:10.438169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e673a01d-9f5e-4c94-9666-4688d82ad99d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:10.446849 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e673a01d-9f5e-4c94-9666-4688d82ad99d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.199682 Aug 08 13:46:10.447865 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 456/920] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:10 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:11.469915 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bec591f6-a6ba-49a1-bd5e-33073347f4ba tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:11.470706 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bec591f6-a6ba-49a1-bd5e-33073347f4ba tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:11.477854 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bec591f6-a6ba-49a1-bd5e-33073347f4ba tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:11.478345 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bec591f6-a6ba-49a1-bd5e-33073347f4ba tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:11.478771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bec591f6-a6ba-49a1-bd5e-33073347f4ba tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:11.479513 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bec591f6-a6ba-49a1-bd5e-33073347f4ba tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:11.479959 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bec591f6-a6ba-49a1-bd5e-33073347f4ba tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:11.480406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bec591f6-a6ba-49a1-bd5e-33073347f4ba tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:11.640580 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bec591f6-a6ba-49a1-bd5e-33073347f4ba tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:11.649617 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bec591f6-a6ba-49a1-bd5e-33073347f4ba tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.185115 Aug 08 13:46:11.650414 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 465/921] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:11 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:12.671267 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1bc734ad-9122-4f06-b9ef-97a95363d19b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:12.672097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1bc734ad-9122-4f06-b9ef-97a95363d19b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:12.678060 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc734ad-9122-4f06-b9ef-97a95363d19b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:12.678790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc734ad-9122-4f06-b9ef-97a95363d19b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:12.679343 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc734ad-9122-4f06-b9ef-97a95363d19b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:12.680051 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc734ad-9122-4f06-b9ef-97a95363d19b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:12.680497 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc734ad-9122-4f06-b9ef-97a95363d19b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:12.680915 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc734ad-9122-4f06-b9ef-97a95363d19b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:12.822786 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1bc734ad-9122-4f06-b9ef-97a95363d19b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:12.831420 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1bc734ad-9122-4f06-b9ef-97a95363d19b tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.165076 Aug 08 13:46:12.832392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 457/922] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:12 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:13.853601 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d78b7663-a40f-4790-849b-e3b061aefbfa tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:13.854298 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d78b7663-a40f-4790-849b-e3b061aefbfa tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:13.861372 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d78b7663-a40f-4790-849b-e3b061aefbfa tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:13.861845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d78b7663-a40f-4790-849b-e3b061aefbfa tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:13.862402 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d78b7663-a40f-4790-849b-e3b061aefbfa tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:13.863354 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d78b7663-a40f-4790-849b-e3b061aefbfa tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:13.863782 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d78b7663-a40f-4790-849b-e3b061aefbfa tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:13.864203 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d78b7663-a40f-4790-849b-e3b061aefbfa tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:14.008121 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d78b7663-a40f-4790-849b-e3b061aefbfa tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:14.018167 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d78b7663-a40f-4790-849b-e3b061aefbfa tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.168406 Aug 08 13:46:14.030979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 466/923] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:13 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:15.040596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-215f8c14-9185-4208-8112-d928b36c37f1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:15.041217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-215f8c14-9185-4208-8112-d928b36c37f1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:15.048883 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-215f8c14-9185-4208-8112-d928b36c37f1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:15.049361 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-215f8c14-9185-4208-8112-d928b36c37f1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:15.049902 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-215f8c14-9185-4208-8112-d928b36c37f1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:15.050620 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-215f8c14-9185-4208-8112-d928b36c37f1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:15.051063 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-215f8c14-9185-4208-8112-d928b36c37f1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:15.051597 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-215f8c14-9185-4208-8112-d928b36c37f1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:15.197406 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-215f8c14-9185-4208-8112-d928b36c37f1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:15.205602 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-215f8c14-9185-4208-8112-d928b36c37f1 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.168898 Aug 08 13:46:15.206231 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 458/924] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:15 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:16.227346 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-842954d1-5b94-476f-80b4-f1d9e82f9ce6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:16.228027 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-842954d1-5b94-476f-80b4-f1d9e82f9ce6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:16.234535 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-842954d1-5b94-476f-80b4-f1d9e82f9ce6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:16.235014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-842954d1-5b94-476f-80b4-f1d9e82f9ce6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:16.235482 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-842954d1-5b94-476f-80b4-f1d9e82f9ce6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:16.236174 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-842954d1-5b94-476f-80b4-f1d9e82f9ce6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:16.236620 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-842954d1-5b94-476f-80b4-f1d9e82f9ce6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:16.237035 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-842954d1-5b94-476f-80b4-f1d9e82f9ce6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:16.376155 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-842954d1-5b94-476f-80b4-f1d9e82f9ce6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:16.385748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-842954d1-5b94-476f-80b4-f1d9e82f9ce6 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.162221 Aug 08 13:46:16.386290 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 467/925] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:16 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:17.406440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6f02503e-02a2-436b-b9ab-c8f7087bcc18 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:17.407116 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6f02503e-02a2-436b-b9ab-c8f7087bcc18 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:17.414088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f02503e-02a2-436b-b9ab-c8f7087bcc18 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:17.414571 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f02503e-02a2-436b-b9ab-c8f7087bcc18 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:17.415000 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f02503e-02a2-436b-b9ab-c8f7087bcc18 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:17.415732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f02503e-02a2-436b-b9ab-c8f7087bcc18 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:17.416318 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f02503e-02a2-436b-b9ab-c8f7087bcc18 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:17.416739 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6f02503e-02a2-436b-b9ab-c8f7087bcc18 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:17.560835 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6f02503e-02a2-436b-b9ab-c8f7087bcc18 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:17.574592 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6f02503e-02a2-436b-b9ab-c8f7087bcc18 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.171626 Aug 08 13:46:17.575745 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 459/926] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:17 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:18.607107 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9dcf6686-56a7-42e9-af2c-eb448d93374c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:18.607728 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9dcf6686-56a7-42e9-af2c-eb448d93374c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:18.615888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9dcf6686-56a7-42e9-af2c-eb448d93374c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:18.616521 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9dcf6686-56a7-42e9-af2c-eb448d93374c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:18.617071 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9dcf6686-56a7-42e9-af2c-eb448d93374c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:18.617987 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9dcf6686-56a7-42e9-af2c-eb448d93374c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:18.618655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9dcf6686-56a7-42e9-af2c-eb448d93374c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:18.619314 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9dcf6686-56a7-42e9-af2c-eb448d93374c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:18.755861 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9dcf6686-56a7-42e9-af2c-eb448d93374c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:18.763945 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9dcf6686-56a7-42e9-af2c-eb448d93374c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.160826 Aug 08 13:46:18.764508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 468/927] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:18 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:19.789655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2bef2ea3-251d-45f1-a6b0-d06a3e6ebb9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:19.790745 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2bef2ea3-251d-45f1-a6b0-d06a3e6ebb9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:19.794713 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:19.802051 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2bef2ea3-251d-45f1-a6b0-d06a3e6ebb9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:19.802734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2bef2ea3-251d-45f1-a6b0-d06a3e6ebb9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:19.803491 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2bef2ea3-251d-45f1-a6b0-d06a3e6ebb9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:19.804530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2bef2ea3-251d-45f1-a6b0-d06a3e6ebb9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:19.805234 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2bef2ea3-251d-45f1-a6b0-d06a3e6ebb9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:19.806019 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2bef2ea3-251d-45f1-a6b0-d06a3e6ebb9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:19.814127 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=93 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:20.240014 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2bef2ea3-251d-45f1-a6b0-d06a3e6ebb9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:20.247532 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2bef2ea3-251d-45f1-a6b0-d06a3e6ebb9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.465100 Aug 08 13:46:20.248115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 460/928] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:19 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:20.964220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-1d5a5501-746a-4704-9704-56954b4d24cb req-4ed4b69b-d0df-4f38-ab03-b9488e924798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6e39bb-b46d-411d-a8b7-d72aec249294", "name": "network-vif-plugged", "status": "completed", "tag": "45702b70-c19c-4c1e-9dba-aa467622e0fa"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:46:20.971674 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:20.977880 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-1d5a5501-746a-4704-9704-56954b4d24cb req-4ed4b69b-d0df-4f38-ab03-b9488e924798 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:20.978373 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-1d5a5501-746a-4704-9704-56954b4d24cb req-4ed4b69b-d0df-4f38-ab03-b9488e924798 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:20.978831 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-1d5a5501-746a-4704-9704-56954b4d24cb req-4ed4b69b-d0df-4f38-ab03-b9488e924798 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:20.982521 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:20.993691 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-1d5a5501-746a-4704-9704-56954b4d24cb req-4ed4b69b-d0df-4f38-ab03-b9488e924798 service nova] Creating event network-vif-plugged:45702b70-c19c-4c1e-9dba-aa467622e0fa for instance cd6e39bb-b46d-411d-a8b7-d72aec249294 on hv-cinder-85199 Aug 08 13:46:20.999511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-1d5a5501-746a-4704-9704-56954b4d24cb req-4ed4b69b-d0df-4f38-ab03-b9488e924798 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038945 Aug 08 13:46:21.000217 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 469/929] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:46:21.272304 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d563de50-bd69-4459-9289-d3a823608fee tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:21.273137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d563de50-bd69-4459-9289-d3a823608fee tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:21.280125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d563de50-bd69-4459-9289-d3a823608fee tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:21.280608 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d563de50-bd69-4459-9289-d3a823608fee tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:21.281090 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d563de50-bd69-4459-9289-d3a823608fee tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:21.281795 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d563de50-bd69-4459-9289-d3a823608fee tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:21.282239 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d563de50-bd69-4459-9289-d3a823608fee tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:21.282655 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d563de50-bd69-4459-9289-d3a823608fee tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:21.436082 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d563de50-bd69-4459-9289-d3a823608fee tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:21.444128 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d563de50-bd69-4459-9289-d3a823608fee tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.176316 Aug 08 13:46:21.444705 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 461/930] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:21 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:22.468198 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-743469c4-801e-4883-b12c-e4c8fab8f8e2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:22.468921 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-743469c4-801e-4883-b12c-e4c8fab8f8e2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:22.476483 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-743469c4-801e-4883-b12c-e4c8fab8f8e2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:22.476957 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-743469c4-801e-4883-b12c-e4c8fab8f8e2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:22.477387 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-743469c4-801e-4883-b12c-e4c8fab8f8e2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:22.478068 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-743469c4-801e-4883-b12c-e4c8fab8f8e2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:22.478530 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-743469c4-801e-4883-b12c-e4c8fab8f8e2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:22.478941 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-743469c4-801e-4883-b12c-e4c8fab8f8e2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:22.628452 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-743469c4-801e-4883-b12c-e4c8fab8f8e2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:22.636178 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-743469c4-801e-4883-b12c-e4c8fab8f8e2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.173887 Aug 08 13:46:22.636743 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 470/931] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:22 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:23.658049 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b1609e8c-d383-45c6-b596-e69cff2b21cd tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:23.658675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b1609e8c-d383-45c6-b596-e69cff2b21cd tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:23.665588 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b1609e8c-d383-45c6-b596-e69cff2b21cd tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:23.666166 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b1609e8c-d383-45c6-b596-e69cff2b21cd tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:23.666609 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b1609e8c-d383-45c6-b596-e69cff2b21cd tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:23.667347 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b1609e8c-d383-45c6-b596-e69cff2b21cd tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:23.667800 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b1609e8c-d383-45c6-b596-e69cff2b21cd tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:23.668227 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b1609e8c-d383-45c6-b596-e69cff2b21cd tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:23.821430 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b1609e8c-d383-45c6-b596-e69cff2b21cd tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:23.850719 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b1609e8c-d383-45c6-b596-e69cff2b21cd tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.196577 Aug 08 13:46:23.852351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 462/932] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:23 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:24.877501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-07a02c0a-071a-4a80-b89c-405625da2924 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:24.878229 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-07a02c0a-071a-4a80-b89c-405625da2924 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:24.885223 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07a02c0a-071a-4a80-b89c-405625da2924 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:24.885916 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07a02c0a-071a-4a80-b89c-405625da2924 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:24.886341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07a02c0a-071a-4a80-b89c-405625da2924 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:24.887044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07a02c0a-071a-4a80-b89c-405625da2924 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:24.887522 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07a02c0a-071a-4a80-b89c-405625da2924 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:24.887941 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-07a02c0a-071a-4a80-b89c-405625da2924 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:25.067238 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-07a02c0a-071a-4a80-b89c-405625da2924 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:25.086404 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-07a02c0a-071a-4a80-b89c-405625da2924 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1359 microversion: 2.1 time: 0.214948 Aug 08 13:46:25.087019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 471/933] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:24 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:26.108152 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e1cbec9c-dbb9-49c0-bad5-fc0186e83a50 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:26.108926 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e1cbec9c-dbb9-49c0-bad5-fc0186e83a50 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:26.116462 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e1cbec9c-dbb9-49c0-bad5-fc0186e83a50 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:26.116900 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e1cbec9c-dbb9-49c0-bad5-fc0186e83a50 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:26.117598 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e1cbec9c-dbb9-49c0-bad5-fc0186e83a50 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:26.118399 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e1cbec9c-dbb9-49c0-bad5-fc0186e83a50 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:26.118903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e1cbec9c-dbb9-49c0-bad5-fc0186e83a50 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:26.119561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e1cbec9c-dbb9-49c0-bad5-fc0186e83a50 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:26.298319 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e1cbec9c-dbb9-49c0-bad5-fc0186e83a50 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:26.309139 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e1cbec9c-dbb9-49c0-bad5-fc0186e83a50 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1548 microversion: 2.1 time: 0.203802 Aug 08 13:46:26.310258 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 463/934] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:26 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:26.330066 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-64f55676-f546-4cdc-a9a9-1f45fbf1d6d4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:26.330748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-64f55676-f546-4cdc-a9a9-1f45fbf1d6d4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:26.337582 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64f55676-f546-4cdc-a9a9-1f45fbf1d6d4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:26.338174 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64f55676-f546-4cdc-a9a9-1f45fbf1d6d4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:26.338740 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64f55676-f546-4cdc-a9a9-1f45fbf1d6d4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:26.339741 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64f55676-f546-4cdc-a9a9-1f45fbf1d6d4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:26.340405 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64f55676-f546-4cdc-a9a9-1f45fbf1d6d4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:26.341263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64f55676-f546-4cdc-a9a9-1f45fbf1d6d4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:26.496676 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-64f55676-f546-4cdc-a9a9-1f45fbf1d6d4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:26.505366 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-64f55676-f546-4cdc-a9a9-1f45fbf1d6d4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1548 microversion: 2.1 time: 0.179230 Aug 08 13:46:26.506180 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 472/935] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:26 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:26.530792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:26.537394 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:26.538289 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Searching by: {'deleted': False, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6'} {{(pid=124407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 08 13:46:26.545743 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:26.546430 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:26.547023 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:26.547957 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:26.548570 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:26.549144 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:26.650226 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.multi_cell_list [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 08 13:46:26.758735 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2ff006fe-1e42-4671-b526-e6b3c200c72e tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.232677 Aug 08 13:46:26.759578 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 464/936] 10.222.0.33 () {58 vars in 1125 bytes} [Mon Aug 8 13:46:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:46:26.775199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4779a8e4-6e89-4e6f-a421-d7873508a727 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:26.777132 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4779a8e4-6e89-4e6f-a421-d7873508a727 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:26.787040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4779a8e4-6e89-4e6f-a421-d7873508a727 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:26.787653 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4779a8e4-6e89-4e6f-a421-d7873508a727 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:26.788102 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4779a8e4-6e89-4e6f-a421-d7873508a727 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:26.789139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4779a8e4-6e89-4e6f-a421-d7873508a727 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:26.789598 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4779a8e4-6e89-4e6f-a421-d7873508a727 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:26.790214 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4779a8e4-6e89-4e6f-a421-d7873508a727 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:26.945863 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4779a8e4-6e89-4e6f-a421-d7873508a727 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:26.953867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4779a8e4-6e89-4e6f-a421-d7873508a727 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1548 microversion: 2.1 time: 0.186289 Aug 08 13:46:26.954672 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 473/937] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:26 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:28.533884 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e2b1aa1f-c6ec-4c8f-b526-6d21acd51568 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adc8c2d6-e6cc-43b8-842d-d1b27079dfa0"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:46:28.536997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e2b1aa1f-c6ec-4c8f-b526-6d21acd51568 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:28.544974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e2b1aa1f-c6ec-4c8f-b526-6d21acd51568 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:28.545596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e2b1aa1f-c6ec-4c8f-b526-6d21acd51568 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:28.546066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e2b1aa1f-c6ec-4c8f-b526-6d21acd51568 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:28.546831 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e2b1aa1f-c6ec-4c8f-b526-6d21acd51568 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:28.547410 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e2b1aa1f-c6ec-4c8f-b526-6d21acd51568 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:28.547884 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e2b1aa1f-c6ec-4c8f-b526-6d21acd51568 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:28.998143 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e2b1aa1f-c6ec-4c8f-b526-6d21acd51568 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "POST /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468250 Aug 08 13:46:28.999356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 465/938] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:46:28 2022] POST /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:46:36.814045 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8af67415-f16c-4e46-9cb9-704c571699c4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:36.814835 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8af67415-f16c-4e46-9cb9-704c571699c4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:36.817443 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=9 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:36.824409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8af67415-f16c-4e46-9cb9-704c571699c4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:36.824896 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8af67415-f16c-4e46-9cb9-704c571699c4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:36.825336 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8af67415-f16c-4e46-9cb9-704c571699c4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:36.826056 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8af67415-f16c-4e46-9cb9-704c571699c4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:36.826512 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8af67415-f16c-4e46-9cb9-704c571699c4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:36.826933 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8af67415-f16c-4e46-9cb9-704c571699c4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:36.999223 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8af67415-f16c-4e46-9cb9-704c571699c4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:37.007805 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8af67415-f16c-4e46-9cb9-704c571699c4 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1594 microversion: 2.1 time: 0.197825 Aug 08 13:46:37.008407 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 474/939] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:36 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1594 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:46:39.843531 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:39.845384 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=11 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:39.846395 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:46:40.053649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-adec36c1-916b-4c09-b08c-5cb58c00217f req-ed726653-0321-4cc1-a623-8020eb578343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6e39bb-b46d-411d-a8b7-d72aec249294", "tag": "45702b70-c19c-4c1e-9dba-aa467622e0fa"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:46:40.075673 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-adec36c1-916b-4c09-b08c-5cb58c00217f req-ed726653-0321-4cc1-a623-8020eb578343 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:40.076703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-adec36c1-916b-4c09-b08c-5cb58c00217f req-ed726653-0321-4cc1-a623-8020eb578343 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:40.077372 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-adec36c1-916b-4c09-b08c-5cb58c00217f req-ed726653-0321-4cc1-a623-8020eb578343 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:40.092414 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-adec36c1-916b-4c09-b08c-5cb58c00217f req-ed726653-0321-4cc1-a623-8020eb578343 service nova] Creating event network-changed:45702b70-c19c-4c1e-9dba-aa467622e0fa for instance cd6e39bb-b46d-411d-a8b7-d72aec249294 on hv-cinder-85199 Aug 08 13:46:40.099960 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-adec36c1-916b-4c09-b08c-5cb58c00217f req-ed726653-0321-4cc1-a623-8020eb578343 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257494 Aug 08 13:46:40.102471 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 466/940] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:46:41.919600 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-41dc0e7e-3832-40d5-ad01-17d3de8b03be tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1924169941"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:46:41.920991 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-41dc0e7e-3832-40d5-ad01-17d3de8b03be tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:41.930469 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41dc0e7e-3832-40d5-ad01-17d3de8b03be tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:41.931209 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41dc0e7e-3832-40d5-ad01-17d3de8b03be tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:41.931855 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41dc0e7e-3832-40d5-ad01-17d3de8b03be tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:41.933094 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41dc0e7e-3832-40d5-ad01-17d3de8b03be tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:41.933937 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41dc0e7e-3832-40d5-ad01-17d3de8b03be tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:41.934667 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-41dc0e7e-3832-40d5-ad01-17d3de8b03be tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:42.132859 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.network.security_group_api [None req-41dc0e7e-3832-40d5-ad01-17d3de8b03be tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Adding security group 728126c7-5938-446e-8c74-61f93dc77730 to port 45702b70-c19c-4c1e-9dba-aa467622e0fa Aug 08 13:46:42.669476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-41dc0e7e-3832-40d5-ad01-17d3de8b03be tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "POST /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/action" status: 202 len: 0 microversion: 2.1 time: 0.745788 Aug 08 13:46:42.669476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 475/941] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:46:41 2022] POST /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/action => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:46:42.672583 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-aa8cd43b-dddd-46b9-8b4a-2ea5b1a08225 req-e5cc40f2-19c3-4dac-acb8-b561ddae02fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6e39bb-b46d-411d-a8b7-d72aec249294", "tag": "45702b70-c19c-4c1e-9dba-aa467622e0fa"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:46:42.683317 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f6f5b025-455f-43d9-9f23-0c9f36080d47 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:46:42.685569 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f6f5b025-455f-43d9-9f23-0c9f36080d47 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:46:42.687564 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-aa8cd43b-dddd-46b9-8b4a-2ea5b1a08225 req-e5cc40f2-19c3-4dac-acb8-b561ddae02fb service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:42.688562 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-aa8cd43b-dddd-46b9-8b4a-2ea5b1a08225 req-e5cc40f2-19c3-4dac-acb8-b561ddae02fb service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:42.689678 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-aa8cd43b-dddd-46b9-8b4a-2ea5b1a08225 req-e5cc40f2-19c3-4dac-acb8-b561ddae02fb service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:42.698080 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6f5b025-455f-43d9-9f23-0c9f36080d47 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:42.698829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6f5b025-455f-43d9-9f23-0c9f36080d47 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:42.699385 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6f5b025-455f-43d9-9f23-0c9f36080d47 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:42.700993 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6f5b025-455f-43d9-9f23-0c9f36080d47 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:46:42.701816 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6f5b025-455f-43d9-9f23-0c9f36080d47 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:46:42.702400 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f6f5b025-455f-43d9-9f23-0c9f36080d47 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:46:42.713001 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-aa8cd43b-dddd-46b9-8b4a-2ea5b1a08225 req-e5cc40f2-19c3-4dac-acb8-b561ddae02fb service nova] Creating event network-changed:45702b70-c19c-4c1e-9dba-aa467622e0fa for instance cd6e39bb-b46d-411d-a8b7-d72aec249294 on hv-cinder-85199 Aug 08 13:46:42.722823 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-aa8cd43b-dddd-46b9-8b4a-2ea5b1a08225 req-e5cc40f2-19c3-4dac-acb8-b561ddae02fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060189 Aug 08 13:46:42.723803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 467/942] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:46:43.413491 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-f6f5b025-455f-43d9-9f23-0c9f36080d47 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:46:43.431849 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f6f5b025-455f-43d9-9f23-0c9f36080d47 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1760 microversion: 2.1 time: 0.757498 Aug 08 13:46:43.431849 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 476/943] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:46:42 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1760 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:31.479581 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1521406463", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "networks": [{"uuid": "fffde307-0490-4c62-afd6-dcc616899ac7"}]}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:47:31.487584 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:47:31.488280 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:47:31.544494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] validate_networks() for [('fffde307-0490-4c62-afd6-dcc616899ac7', None, None, None, None, None)] {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:47:31.910061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:47:31.910484 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:47:31.910961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:47:31.911609 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:47:31.912336 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:47:31.922098 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:31.922586 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:31.923018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:31.923788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:31.924247 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:31.924670 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:31.946850 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Getting quotas for project 5a479cfd62f048a5aae793d449e9e9d4. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:47:31.951190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Getting quotas for user 9cf127f9aa17428bb43df644e17434c6 and project 5a479cfd62f048a5aae793d449e9e9d4. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:47:31.962311 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:47:31.964744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:47:32.019222 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1a5ab34e-10dd-4d9f-8192-57051c639102 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543958 Aug 08 13:47:32.020055 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 468/944] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:47:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:47:32.031030 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a46d6b48-f0da-4caa-a9dc-f5f0abd38be7 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:32.031693 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a46d6b48-f0da-4caa-a9dc-f5f0abd38be7 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:32.033943 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:47:32.034564 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=41 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:47:32.090702 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a46d6b48-f0da-4caa-a9dc-f5f0abd38be7 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:32.098398 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a46d6b48-f0da-4caa-a9dc-f5f0abd38be7 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1219 microversion: 2.1 time: 0.071332 Aug 08 13:47:32.098989 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 477/945] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:32 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:33.125584 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9a522f9c-2259-4412-8864-4b26577b72da tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:33.125584 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9a522f9c-2259-4412-8864-4b26577b72da tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:33.180152 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9a522f9c-2259-4412-8864-4b26577b72da tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:33.187978 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9a522f9c-2259-4412-8864-4b26577b72da tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1219 microversion: 2.1 time: 0.067380 Aug 08 13:47:33.188680 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 469/946] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:33 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:34.213015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4dae3405-86ed-46a0-b0c2-3b088bc08bc4 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:34.213637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4dae3405-86ed-46a0-b0c2-3b088bc08bc4 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:34.274392 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4dae3405-86ed-46a0-b0c2-3b088bc08bc4 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:34.282129 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4dae3405-86ed-46a0-b0c2-3b088bc08bc4 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1219 microversion: 2.1 time: 0.075460 Aug 08 13:47:34.282928 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 478/947] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:34 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:35.304478 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-89585dd4-2d4f-499d-9d59-f94b72d9f0ea tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:35.305074 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-89585dd4-2d4f-499d-9d59-f94b72d9f0ea tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:35.359772 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-89585dd4-2d4f-499d-9d59-f94b72d9f0ea tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:35.367283 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-89585dd4-2d4f-499d-9d59-f94b72d9f0ea tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1219 microversion: 2.1 time: 0.067242 Aug 08 13:47:35.367896 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 470/948] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:35 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:36.390916 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-2946851b-d093-418b-ae71-0a786141392e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:36.391627 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-2946851b-d093-418b-ae71-0a786141392e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:36.401023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2946851b-d093-418b-ae71-0a786141392e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:36.401682 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2946851b-d093-418b-ae71-0a786141392e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:36.402263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2946851b-d093-418b-ae71-0a786141392e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:36.403385 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2946851b-d093-418b-ae71-0a786141392e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:36.404032 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2946851b-d093-418b-ae71-0a786141392e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:36.404715 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-2946851b-d093-418b-ae71-0a786141392e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:36.493031 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-2946851b-d093-418b-ae71-0a786141392e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:36.501610 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-2946851b-d093-418b-ae71-0a786141392e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1223 microversion: 2.1 time: 0.115902 Aug 08 13:47:36.502180 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 479/949] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:36 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:37.526061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-acae08a1-eeeb-4114-999a-8e2cd2c2595f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:37.526798 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-acae08a1-eeeb-4114-999a-8e2cd2c2595f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:37.535387 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-acae08a1-eeeb-4114-999a-8e2cd2c2595f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:37.535714 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-acae08a1-eeeb-4114-999a-8e2cd2c2595f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:37.536246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-acae08a1-eeeb-4114-999a-8e2cd2c2595f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:37.536961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-acae08a1-eeeb-4114-999a-8e2cd2c2595f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:37.537511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-acae08a1-eeeb-4114-999a-8e2cd2c2595f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:37.538643 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-acae08a1-eeeb-4114-999a-8e2cd2c2595f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:37.613468 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-acae08a1-eeeb-4114-999a-8e2cd2c2595f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:37.621146 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-acae08a1-eeeb-4114-999a-8e2cd2c2595f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1277 microversion: 2.1 time: 0.098987 Aug 08 13:47:37.621727 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 471/950] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:37 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:47:38.643704 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1008e4b8-c2fe-45ec-846f-ff1c7ed78c97 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:38.644356 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1008e4b8-c2fe-45ec-846f-ff1c7ed78c97 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:38.652544 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1008e4b8-c2fe-45ec-846f-ff1c7ed78c97 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:38.653744 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1008e4b8-c2fe-45ec-846f-ff1c7ed78c97 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:38.654257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1008e4b8-c2fe-45ec-846f-ff1c7ed78c97 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:38.655171 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1008e4b8-c2fe-45ec-846f-ff1c7ed78c97 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:38.655615 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1008e4b8-c2fe-45ec-846f-ff1c7ed78c97 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:38.656041 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1008e4b8-c2fe-45ec-846f-ff1c7ed78c97 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:38.812846 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-400ec323-8c96-4053-ae9b-094917883b03 req-4a785167-7ad3-4f9a-bba5-f2effb4f2496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa31e02-ef49-475f-9d0d-787e94148547", "tag": "edd7fd46-922f-4dc9-8e3c-ef9e0fa39126"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:47:38.824525 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-400ec323-8c96-4053-ae9b-094917883b03 req-4a785167-7ad3-4f9a-bba5-f2effb4f2496 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:38.825083 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-400ec323-8c96-4053-ae9b-094917883b03 req-4a785167-7ad3-4f9a-bba5-f2effb4f2496 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:38.825595 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-400ec323-8c96-4053-ae9b-094917883b03 req-4a785167-7ad3-4f9a-bba5-f2effb4f2496 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:38.840765 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-400ec323-8c96-4053-ae9b-094917883b03 req-4a785167-7ad3-4f9a-bba5-f2effb4f2496 service nova] Creating event network-changed:edd7fd46-922f-4dc9-8e3c-ef9e0fa39126 for instance 8fa31e02-ef49-475f-9d0d-787e94148547 on hv-cinder-85199 Aug 08 13:47:38.846380 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-400ec323-8c96-4053-ae9b-094917883b03 req-4a785167-7ad3-4f9a-bba5-f2effb4f2496 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036826 Aug 08 13:47:38.847468 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 472/951] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:47:38.856600 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-1008e4b8-c2fe-45ec-846f-ff1c7ed78c97 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:38.867645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1008e4b8-c2fe-45ec-846f-ff1c7ed78c97 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1319 microversion: 2.1 time: 0.227737 Aug 08 13:47:38.868168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 480/952] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:38 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:39.953009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9c109696-9e5f-4709-b175-c804f0322c57 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:39.953721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9c109696-9e5f-4709-b175-c804f0322c57 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:39.961904 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9c109696-9e5f-4709-b175-c804f0322c57 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:39.962436 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9c109696-9e5f-4709-b175-c804f0322c57 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:39.962986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9c109696-9e5f-4709-b175-c804f0322c57 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:39.963979 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9c109696-9e5f-4709-b175-c804f0322c57 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:39.964721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9c109696-9e5f-4709-b175-c804f0322c57 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:39.964862 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9c109696-9e5f-4709-b175-c804f0322c57 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:40.106439 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9c109696-9e5f-4709-b175-c804f0322c57 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:40.114082 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9c109696-9e5f-4709-b175-c804f0322c57 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1319 microversion: 2.1 time: 0.167923 Aug 08 13:47:40.114664 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 473/953] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:39 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:41.135646 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-57086fdc-2c0c-4dc1-9575-5a00f142e842 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:41.136311 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-57086fdc-2c0c-4dc1-9575-5a00f142e842 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:41.143070 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57086fdc-2c0c-4dc1-9575-5a00f142e842 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:41.143585 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57086fdc-2c0c-4dc1-9575-5a00f142e842 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:41.144009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57086fdc-2c0c-4dc1-9575-5a00f142e842 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:41.144707 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57086fdc-2c0c-4dc1-9575-5a00f142e842 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:41.145152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57086fdc-2c0c-4dc1-9575-5a00f142e842 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:41.145568 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-57086fdc-2c0c-4dc1-9575-5a00f142e842 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:41.297376 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-57086fdc-2c0c-4dc1-9575-5a00f142e842 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:41.309805 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-57086fdc-2c0c-4dc1-9575-5a00f142e842 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1319 microversion: 2.1 time: 0.177743 Aug 08 13:47:41.310606 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 481/954] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:41 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:42.339954 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-9630731d-c131-4a85-96d6-4af1a42dbb8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:42.340564 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-9630731d-c131-4a85-96d6-4af1a42dbb8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:42.343000 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:47:42.348848 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9630731d-c131-4a85-96d6-4af1a42dbb8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:42.349325 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9630731d-c131-4a85-96d6-4af1a42dbb8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:42.349757 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9630731d-c131-4a85-96d6-4af1a42dbb8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:42.350547 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9630731d-c131-4a85-96d6-4af1a42dbb8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:42.351024 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9630731d-c131-4a85-96d6-4af1a42dbb8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:42.351448 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-9630731d-c131-4a85-96d6-4af1a42dbb8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:42.564364 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-9630731d-c131-4a85-96d6-4af1a42dbb8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:42.573251 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-9630731d-c131-4a85-96d6-4af1a42dbb8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1319 microversion: 2.1 time: 0.237074 Aug 08 13:47:42.574221 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 474/955] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:42 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:43.601143 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9e9cd358-110b-4412-9896-b308bd4a1b64 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:43.601769 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9e9cd358-110b-4412-9896-b308bd4a1b64 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:43.609151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9e9cd358-110b-4412-9896-b308bd4a1b64 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:43.609630 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9e9cd358-110b-4412-9896-b308bd4a1b64 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:43.610060 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9e9cd358-110b-4412-9896-b308bd4a1b64 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:43.610750 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9e9cd358-110b-4412-9896-b308bd4a1b64 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:43.611230 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9e9cd358-110b-4412-9896-b308bd4a1b64 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:43.611650 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9e9cd358-110b-4412-9896-b308bd4a1b64 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:43.767602 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9e9cd358-110b-4412-9896-b308bd4a1b64 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:43.775693 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9e9cd358-110b-4412-9896-b308bd4a1b64 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1319 microversion: 2.1 time: 0.180666 Aug 08 13:47:43.776258 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 482/956] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:43 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:44.797350 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-bae866bf-9cae-4f27-ae7c-c5c340115eae tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:44.797914 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-bae866bf-9cae-4f27-ae7c-c5c340115eae tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:44.804739 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bae866bf-9cae-4f27-ae7c-c5c340115eae tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:44.805210 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bae866bf-9cae-4f27-ae7c-c5c340115eae tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:44.805629 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bae866bf-9cae-4f27-ae7c-c5c340115eae tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:44.806458 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bae866bf-9cae-4f27-ae7c-c5c340115eae tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:44.806903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bae866bf-9cae-4f27-ae7c-c5c340115eae tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:44.807340 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-bae866bf-9cae-4f27-ae7c-c5c340115eae tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:44.949792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-bae866bf-9cae-4f27-ae7c-c5c340115eae tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:44.958027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-bae866bf-9cae-4f27-ae7c-c5c340115eae tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1319 microversion: 2.1 time: 0.164774 Aug 08 13:47:44.958561 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 475/957] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:44 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:45.522022 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=4 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:47:45.656538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-a779f738-d5d5-4735-8f03-4051f089db16 req-09014d3a-5c34-495b-af16-b3e652542eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa31e02-ef49-475f-9d0d-787e94148547", "name": "network-vif-plugged", "status": "completed", "tag": "edd7fd46-922f-4dc9-8e3c-ef9e0fa39126"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:47:45.666580 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-a779f738-d5d5-4735-8f03-4051f089db16 req-09014d3a-5c34-495b-af16-b3e652542eda service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:45.667054 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-a779f738-d5d5-4735-8f03-4051f089db16 req-09014d3a-5c34-495b-af16-b3e652542eda service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:45.667509 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-a779f738-d5d5-4735-8f03-4051f089db16 req-09014d3a-5c34-495b-af16-b3e652542eda service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:45.678566 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-a779f738-d5d5-4735-8f03-4051f089db16 req-09014d3a-5c34-495b-af16-b3e652542eda service nova] Creating event network-vif-plugged:edd7fd46-922f-4dc9-8e3c-ef9e0fa39126 for instance 8fa31e02-ef49-475f-9d0d-787e94148547 on hv-cinder-85199 Aug 08 13:47:45.683917 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-a779f738-d5d5-4735-8f03-4051f089db16 req-09014d3a-5c34-495b-af16-b3e652542eda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167043 Aug 08 13:47:45.684615 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 483/958] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:47:45.983003 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-da85c69f-cf8c-46e2-a764-fe975debeb8d tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:45.983607 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-da85c69f-cf8c-46e2-a764-fe975debeb8d tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:45.985493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=10 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:47:45.991484 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-da85c69f-cf8c-46e2-a764-fe975debeb8d tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:45.991954 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-da85c69f-cf8c-46e2-a764-fe975debeb8d tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:45.992372 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-da85c69f-cf8c-46e2-a764-fe975debeb8d tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:45.993055 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-da85c69f-cf8c-46e2-a764-fe975debeb8d tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:45.993494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-da85c69f-cf8c-46e2-a764-fe975debeb8d tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:45.993907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-da85c69f-cf8c-46e2-a764-fe975debeb8d tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:46.128537 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-da85c69f-cf8c-46e2-a764-fe975debeb8d tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:46.136025 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-da85c69f-cf8c-46e2-a764-fe975debeb8d tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1319 microversion: 2.1 time: 0.158777 Aug 08 13:47:46.136590 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 476/959] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:45 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:47.162770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-069b60c1-7393-43c5-a349-5a6f18ece489 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:47.163840 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-069b60c1-7393-43c5-a349-5a6f18ece489 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:47.173223 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069b60c1-7393-43c5-a349-5a6f18ece489 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:47.173959 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069b60c1-7393-43c5-a349-5a6f18ece489 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:47.174557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069b60c1-7393-43c5-a349-5a6f18ece489 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:47.175700 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069b60c1-7393-43c5-a349-5a6f18ece489 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:47.176394 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069b60c1-7393-43c5-a349-5a6f18ece489 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:47.177073 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-069b60c1-7393-43c5-a349-5a6f18ece489 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:47.309952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-069b60c1-7393-43c5-a349-5a6f18ece489 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:47.317714 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-069b60c1-7393-43c5-a349-5a6f18ece489 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1319 microversion: 2.1 time: 0.162095 Aug 08 13:47:47.318279 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 484/960] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:47 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:48.339475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0cce4599-0978-4e59-b7c9-2ab554b3c8c1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:47:48.340024 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0cce4599-0978-4e59-b7c9-2ab554b3c8c1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:47:48.347347 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cce4599-0978-4e59-b7c9-2ab554b3c8c1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:48.347832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cce4599-0978-4e59-b7c9-2ab554b3c8c1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:48.348264 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cce4599-0978-4e59-b7c9-2ab554b3c8c1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:48.348969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cce4599-0978-4e59-b7c9-2ab554b3c8c1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:47:48.349417 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cce4599-0978-4e59-b7c9-2ab554b3c8c1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:47:48.349840 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cce4599-0978-4e59-b7c9-2ab554b3c8c1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:47:48.492991 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0cce4599-0978-4e59-b7c9-2ab554b3c8c1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:47:48.501443 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0cce4599-0978-4e59-b7c9-2ab554b3c8c1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1507 microversion: 2.1 time: 0.166072 Aug 08 13:47:48.502082 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 477/961] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:47:48 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:47:54.187994 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 13:47:54.188585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Mon Aug 8 13:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 13:47:54.222328 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 13:47:54.222894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Mon Aug 8 13:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 13:48:06.034181 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-cd1f6393-9fd0-44e6-8320-a03786178eab tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:48:06.037980 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-cd1f6393-9fd0-44e6-8320-a03786178eab tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:06.040887 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=20 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:06.041527 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=32 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:06.048278 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd1f6393-9fd0-44e6-8320-a03786178eab tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:06.048755 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd1f6393-9fd0-44e6-8320-a03786178eab tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:06.049185 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd1f6393-9fd0-44e6-8320-a03786178eab tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:06.049878 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd1f6393-9fd0-44e6-8320-a03786178eab tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:06.050318 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd1f6393-9fd0-44e6-8320-a03786178eab tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:06.050715 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-cd1f6393-9fd0-44e6-8320-a03786178eab tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:06.130334 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-cd1f6393-9fd0-44e6-8320-a03786178eab tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "POST /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/action" status: 202 len: 0 microversion: 2.1 time: 0.102433 Aug 08 13:48:06.131162 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 485/962] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:48:06 2022] POST /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:48:06.139542 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1232ece7-db9c-4e3b-8326-e5e6f7b25933 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:06.140150 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1232ece7-db9c-4e3b-8326-e5e6f7b25933 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:06.142293 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:06.142946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=40 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:06.149970 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1232ece7-db9c-4e3b-8326-e5e6f7b25933 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:06.150455 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1232ece7-db9c-4e3b-8326-e5e6f7b25933 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:06.150952 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1232ece7-db9c-4e3b-8326-e5e6f7b25933 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:06.151783 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1232ece7-db9c-4e3b-8326-e5e6f7b25933 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:06.152242 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1232ece7-db9c-4e3b-8326-e5e6f7b25933 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:06.152667 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1232ece7-db9c-4e3b-8326-e5e6f7b25933 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:06.384990 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1232ece7-db9c-4e3b-8326-e5e6f7b25933 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:06.396376 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1232ece7-db9c-4e3b-8326-e5e6f7b25933 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1752 microversion: 2.1 time: 0.260640 Aug 08 13:48:06.397159 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 478/963] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:06 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1752 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:07.420440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c1e18a1e-6dec-43c7-9235-cbf0bbef23c8 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:07.421149 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c1e18a1e-6dec-43c7-9235-cbf0bbef23c8 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:07.428263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1e18a1e-6dec-43c7-9235-cbf0bbef23c8 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:07.428740 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1e18a1e-6dec-43c7-9235-cbf0bbef23c8 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:07.429177 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1e18a1e-6dec-43c7-9235-cbf0bbef23c8 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:07.429878 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1e18a1e-6dec-43c7-9235-cbf0bbef23c8 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:07.430351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1e18a1e-6dec-43c7-9235-cbf0bbef23c8 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:07.430772 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c1e18a1e-6dec-43c7-9235-cbf0bbef23c8 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:07.581787 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c1e18a1e-6dec-43c7-9235-cbf0bbef23c8 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:07.592031 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c1e18a1e-6dec-43c7-9235-cbf0bbef23c8 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1757 microversion: 2.1 time: 0.175923 Aug 08 13:48:07.592583 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 486/964] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:07 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:08.614505 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3248bc21-1cb6-4d28-923f-d67bcdf1c769 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:08.615157 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3248bc21-1cb6-4d28-923f-d67bcdf1c769 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:08.622127 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3248bc21-1cb6-4d28-923f-d67bcdf1c769 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:08.622618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3248bc21-1cb6-4d28-923f-d67bcdf1c769 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:08.623026 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3248bc21-1cb6-4d28-923f-d67bcdf1c769 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:08.623754 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3248bc21-1cb6-4d28-923f-d67bcdf1c769 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:08.624193 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3248bc21-1cb6-4d28-923f-d67bcdf1c769 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:08.624610 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3248bc21-1cb6-4d28-923f-d67bcdf1c769 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:08.778842 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3248bc21-1cb6-4d28-923f-d67bcdf1c769 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:08.791326 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3248bc21-1cb6-4d28-923f-d67bcdf1c769 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1757 microversion: 2.1 time: 0.180629 Aug 08 13:48:08.791889 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 479/965] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:08 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:09.814277 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3037b53b-7632-4f01-a0a6-458a3d5465e3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:09.814899 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3037b53b-7632-4f01-a0a6-458a3d5465e3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:09.821853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3037b53b-7632-4f01-a0a6-458a3d5465e3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:09.822329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3037b53b-7632-4f01-a0a6-458a3d5465e3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:09.822758 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3037b53b-7632-4f01-a0a6-458a3d5465e3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:09.823478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3037b53b-7632-4f01-a0a6-458a3d5465e3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:09.823936 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3037b53b-7632-4f01-a0a6-458a3d5465e3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:09.824354 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3037b53b-7632-4f01-a0a6-458a3d5465e3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:09.972790 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3037b53b-7632-4f01-a0a6-458a3d5465e3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:09.980864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3037b53b-7632-4f01-a0a6-458a3d5465e3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1757 microversion: 2.1 time: 0.170599 Aug 08 13:48:09.981425 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 487/966] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:09 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:11.002247 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-61355963-1c2c-4e96-8bb8-1a74959361d5 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:11.002978 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-61355963-1c2c-4e96-8bb8-1a74959361d5 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:11.009742 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-61355963-1c2c-4e96-8bb8-1a74959361d5 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:11.010220 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-61355963-1c2c-4e96-8bb8-1a74959361d5 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:11.010650 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-61355963-1c2c-4e96-8bb8-1a74959361d5 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:11.011364 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-61355963-1c2c-4e96-8bb8-1a74959361d5 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:11.011789 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-61355963-1c2c-4e96-8bb8-1a74959361d5 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:11.012250 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-61355963-1c2c-4e96-8bb8-1a74959361d5 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:11.163638 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-61355963-1c2c-4e96-8bb8-1a74959361d5 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:11.171867 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-61355963-1c2c-4e96-8bb8-1a74959361d5 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1757 microversion: 2.1 time: 0.173612 Aug 08 13:48:11.172428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 480/967] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:10 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:12.192581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fce36e14-d83d-488c-9ab4-7cccce3eb415 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:12.193213 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fce36e14-d83d-488c-9ab4-7cccce3eb415 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:12.199874 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fce36e14-d83d-488c-9ab4-7cccce3eb415 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:12.200121 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fce36e14-d83d-488c-9ab4-7cccce3eb415 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:12.200550 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fce36e14-d83d-488c-9ab4-7cccce3eb415 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:12.201251 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fce36e14-d83d-488c-9ab4-7cccce3eb415 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:12.201702 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fce36e14-d83d-488c-9ab4-7cccce3eb415 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:12.202121 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fce36e14-d83d-488c-9ab4-7cccce3eb415 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:12.369613 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fce36e14-d83d-488c-9ab4-7cccce3eb415 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:12.378635 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fce36e14-d83d-488c-9ab4-7cccce3eb415 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1757 microversion: 2.1 time: 0.189983 Aug 08 13:48:12.379455 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 488/968] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:12 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:13.292986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5ecc0d57-37d5-48b5-9c37-4dd6ce83ebd9 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50fa2d0c-50b1-4977-b5b6-3b9c586a465e", "device": "/dev/sdb"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:48:13.296340 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5ecc0d57-37d5-48b5-9c37-4dd6ce83ebd9 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:13.303109 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ecc0d57-37d5-48b5-9c37-4dd6ce83ebd9 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:13.303708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ecc0d57-37d5-48b5-9c37-4dd6ce83ebd9 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:13.304142 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ecc0d57-37d5-48b5-9c37-4dd6ce83ebd9 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:13.304836 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ecc0d57-37d5-48b5-9c37-4dd6ce83ebd9 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:13.305278 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ecc0d57-37d5-48b5-9c37-4dd6ce83ebd9 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:13.305724 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5ecc0d57-37d5-48b5-9c37-4dd6ce83ebd9 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:13.400776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-75d62125-51e5-4f6c-87f8-a19449ce1b45 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:13.401350 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-75d62125-51e5-4f6c-87f8-a19449ce1b45 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:13.407997 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-75d62125-51e5-4f6c-87f8-a19449ce1b45 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:13.409241 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-75d62125-51e5-4f6c-87f8-a19449ce1b45 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:13.409671 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-75d62125-51e5-4f6c-87f8-a19449ce1b45 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:13.410523 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-75d62125-51e5-4f6c-87f8-a19449ce1b45 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:13.410978 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-75d62125-51e5-4f6c-87f8-a19449ce1b45 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:13.411421 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-75d62125-51e5-4f6c-87f8-a19449ce1b45 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:13.565403 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-75d62125-51e5-4f6c-87f8-a19449ce1b45 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:13.574130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-75d62125-51e5-4f6c-87f8-a19449ce1b45 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1757 microversion: 2.1 time: 0.177196 Aug 08 13:48:13.574691 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 489/969] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:13 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:48:13.578129 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5ecc0d57-37d5-48b5-9c37-4dd6ce83ebd9 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "POST /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290259 Aug 08 13:48:13.578893 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 481/970] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:48:13 2022] POST /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:48:14.597516 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-40e17dab-4936-474e-adaa-6fddbdc08b9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:14.598800 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-40e17dab-4936-474e-adaa-6fddbdc08b9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:14.605604 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40e17dab-4936-474e-adaa-6fddbdc08b9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:14.606089 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40e17dab-4936-474e-adaa-6fddbdc08b9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:14.606526 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40e17dab-4936-474e-adaa-6fddbdc08b9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:14.607381 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40e17dab-4936-474e-adaa-6fddbdc08b9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:14.608002 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40e17dab-4936-474e-adaa-6fddbdc08b9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:14.608433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-40e17dab-4936-474e-adaa-6fddbdc08b9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:14.761132 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-40e17dab-4936-474e-adaa-6fddbdc08b9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:14.770963 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-40e17dab-4936-474e-adaa-6fddbdc08b9f tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1757 microversion: 2.1 time: 0.177761 Aug 08 13:48:14.771552 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 490/971] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:14 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:15.796376 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a8d53311-e549-4e59-8eb5-6a7d257ae672 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:15.797290 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a8d53311-e549-4e59-8eb5-6a7d257ae672 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:15.806756 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a8d53311-e549-4e59-8eb5-6a7d257ae672 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:15.807489 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a8d53311-e549-4e59-8eb5-6a7d257ae672 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:15.808087 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a8d53311-e549-4e59-8eb5-6a7d257ae672 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:15.809133 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a8d53311-e549-4e59-8eb5-6a7d257ae672 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:15.809716 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a8d53311-e549-4e59-8eb5-6a7d257ae672 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:15.810136 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a8d53311-e549-4e59-8eb5-6a7d257ae672 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:15.973492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a8d53311-e549-4e59-8eb5-6a7d257ae672 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:15.985517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a8d53311-e549-4e59-8eb5-6a7d257ae672 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1757 microversion: 2.1 time: 0.195683 Aug 08 13:48:15.986358 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 482/972] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:15 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:17.015302 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b1896a33-0fdf-4780-8b15-9291d1da5598 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:17.015916 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b1896a33-0fdf-4780-8b15-9291d1da5598 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:17.022927 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b1896a33-0fdf-4780-8b15-9291d1da5598 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:17.023377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b1896a33-0fdf-4780-8b15-9291d1da5598 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:17.023808 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b1896a33-0fdf-4780-8b15-9291d1da5598 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:17.024501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b1896a33-0fdf-4780-8b15-9291d1da5598 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:17.024979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b1896a33-0fdf-4780-8b15-9291d1da5598 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:17.025395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b1896a33-0fdf-4780-8b15-9291d1da5598 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:17.178754 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b1896a33-0fdf-4780-8b15-9291d1da5598 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:17.187596 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b1896a33-0fdf-4780-8b15-9291d1da5598 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1757 microversion: 2.1 time: 0.178293 Aug 08 13:48:17.188161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 491/973] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:17 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:18.209071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0011de48-51d0-4cc7-9328-1c10f2ff2f05 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:18.209710 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0011de48-51d0-4cc7-9328-1c10f2ff2f05 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:18.217351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0011de48-51d0-4cc7-9328-1c10f2ff2f05 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:18.217822 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0011de48-51d0-4cc7-9328-1c10f2ff2f05 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:18.218228 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0011de48-51d0-4cc7-9328-1c10f2ff2f05 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:18.218944 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0011de48-51d0-4cc7-9328-1c10f2ff2f05 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:18.219439 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0011de48-51d0-4cc7-9328-1c10f2ff2f05 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:18.219859 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0011de48-51d0-4cc7-9328-1c10f2ff2f05 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:18.373384 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0011de48-51d0-4cc7-9328-1c10f2ff2f05 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:18.382662 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0011de48-51d0-4cc7-9328-1c10f2ff2f05 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1757 microversion: 2.1 time: 0.177790 Aug 08 13:48:18.383285 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 483/974] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:18 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:19.406160 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bc4c8b5d-c8cf-4081-a7b3-332119419e5d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:19.406829 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bc4c8b5d-c8cf-4081-a7b3-332119419e5d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:19.415505 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc4c8b5d-c8cf-4081-a7b3-332119419e5d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:19.416255 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc4c8b5d-c8cf-4081-a7b3-332119419e5d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:19.416896 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc4c8b5d-c8cf-4081-a7b3-332119419e5d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:19.417880 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc4c8b5d-c8cf-4081-a7b3-332119419e5d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:19.418562 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc4c8b5d-c8cf-4081-a7b3-332119419e5d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:19.419210 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc4c8b5d-c8cf-4081-a7b3-332119419e5d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:19.582807 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bc4c8b5d-c8cf-4081-a7b3-332119419e5d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:19.591803 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bc4c8b5d-c8cf-4081-a7b3-332119419e5d tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1760 microversion: 2.1 time: 0.189767 Aug 08 13:48:19.592475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 492/975] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:19 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1760 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:40.570357 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-fec50ba8-11ce-4aff-9124-e94cf497e1d2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:40.570993 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-fec50ba8-11ce-4aff-9124-e94cf497e1d2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:40.573558 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=12 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:40.574219 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:40.579711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fec50ba8-11ce-4aff-9124-e94cf497e1d2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:40.580193 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fec50ba8-11ce-4aff-9124-e94cf497e1d2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:40.580619 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fec50ba8-11ce-4aff-9124-e94cf497e1d2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:40.581321 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fec50ba8-11ce-4aff-9124-e94cf497e1d2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:40.581761 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fec50ba8-11ce-4aff-9124-e94cf497e1d2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:40.582168 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-fec50ba8-11ce-4aff-9124-e94cf497e1d2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:40.673377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.objects.instance [None req-fec50ba8-11ce-4aff-9124-e94cf497e1d2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lazy-loading 'services' on Instance uuid 8fa31e02-ef49-475f-9d0d-787e94148547 {{(pid=124407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:48:40.750540 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-fec50ba8-11ce-4aff-9124-e94cf497e1d2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547/os-volume_attachments/50fa2d0c-50b1-4977-b5b6-3b9c586a465e" status: 202 len: 0 microversion: 2.1 time: 0.184305 Aug 08 13:48:40.751266 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 484/976] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:48:40 2022] DELETE /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547/os-volume_attachments/50fa2d0c-50b1-4977-b5b6-3b9c586a465e => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:48:41.888597 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c5c9d9ea-fe7e-40a8-ae40-fef3c8de6ddf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:41.889163 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c5c9d9ea-fe7e-40a8-ae40-fef3c8de6ddf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:41.891268 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=16 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:41.891932 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:41.898131 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c9d9ea-fe7e-40a8-ae40-fef3c8de6ddf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:41.898618 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c9d9ea-fe7e-40a8-ae40-fef3c8de6ddf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:41.899047 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c9d9ea-fe7e-40a8-ae40-fef3c8de6ddf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:41.899777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c9d9ea-fe7e-40a8-ae40-fef3c8de6ddf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:41.900218 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c9d9ea-fe7e-40a8-ae40-fef3c8de6ddf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:41.900684 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c9d9ea-fe7e-40a8-ae40-fef3c8de6ddf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:41.927908 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c5c9d9ea-fe7e-40a8-ae40-fef3c8de6ddf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Going to try to terminate instance {{(pid=124408) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:48:42.016926 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c5c9d9ea-fe7e-40a8-ae40-fef3c8de6ddf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 204 len: 0 microversion: 2.1 time: 0.132134 Aug 08 13:48:42.017508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 493/977] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:48:41 2022] DELETE /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:48:42.029425 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8e1d3047-9e5b-49f2-b14e-959a38ba67a6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:42.030140 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8e1d3047-9e5b-49f2-b14e-959a38ba67a6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:42.038219 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e1d3047-9e5b-49f2-b14e-959a38ba67a6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:42.038690 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e1d3047-9e5b-49f2-b14e-959a38ba67a6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:42.039152 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e1d3047-9e5b-49f2-b14e-959a38ba67a6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:42.039840 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e1d3047-9e5b-49f2-b14e-959a38ba67a6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:42.040283 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e1d3047-9e5b-49f2-b14e-959a38ba67a6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:42.040694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e1d3047-9e5b-49f2-b14e-959a38ba67a6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:42.177974 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8e1d3047-9e5b-49f2-b14e-959a38ba67a6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:42.186054 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8e1d3047-9e5b-49f2-b14e-959a38ba67a6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1513 microversion: 2.1 time: 0.163489 Aug 08 13:48:42.186634 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 485/978] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:42 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:43.213249 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ff5e6f4a-31a1-4471-a688-4df196503510 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:43.213955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ff5e6f4a-31a1-4471-a688-4df196503510 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:43.221263 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5e6f4a-31a1-4471-a688-4df196503510 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:43.221765 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5e6f4a-31a1-4471-a688-4df196503510 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:43.222194 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5e6f4a-31a1-4471-a688-4df196503510 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:43.222894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5e6f4a-31a1-4471-a688-4df196503510 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:43.223377 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5e6f4a-31a1-4471-a688-4df196503510 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:43.223801 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff5e6f4a-31a1-4471-a688-4df196503510 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:43.364745 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ff5e6f4a-31a1-4471-a688-4df196503510 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:43.372828 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ff5e6f4a-31a1-4471-a688-4df196503510 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1513 microversion: 2.1 time: 0.164012 Aug 08 13:48:43.373374 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 494/979] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:43 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:44.399395 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a5b168c5-6546-4768-a049-fa5909798d81 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:44.399965 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a5b168c5-6546-4768-a049-fa5909798d81 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:44.406729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a5b168c5-6546-4768-a049-fa5909798d81 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:44.407238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a5b168c5-6546-4768-a049-fa5909798d81 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:44.407677 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a5b168c5-6546-4768-a049-fa5909798d81 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:44.408374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a5b168c5-6546-4768-a049-fa5909798d81 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:44.408820 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a5b168c5-6546-4768-a049-fa5909798d81 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:44.409232 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a5b168c5-6546-4768-a049-fa5909798d81 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:44.596420 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a5b168c5-6546-4768-a049-fa5909798d81 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:44.604877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a5b168c5-6546-4768-a049-fa5909798d81 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1513 microversion: 2.1 time: 0.209660 Aug 08 13:48:44.605672 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 486/980] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:44 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:44.747562 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-3d0fabee-076e-4d73-9429-2c16851919d2 req-046eb25d-338d-4acc-8fa0-a99b38827981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa31e02-ef49-475f-9d0d-787e94148547", "name": "network-vif-deleted", "tag": "edd7fd46-922f-4dc9-8e3c-ef9e0fa39126"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:48:44.758597 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-3d0fabee-076e-4d73-9429-2c16851919d2 req-046eb25d-338d-4acc-8fa0-a99b38827981 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:44.759179 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-3d0fabee-076e-4d73-9429-2c16851919d2 req-046eb25d-338d-4acc-8fa0-a99b38827981 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:44.759598 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-3d0fabee-076e-4d73-9429-2c16851919d2 req-046eb25d-338d-4acc-8fa0-a99b38827981 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:44.771931 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-3d0fabee-076e-4d73-9429-2c16851919d2 req-046eb25d-338d-4acc-8fa0-a99b38827981 service nova] Creating event network-vif-deleted:edd7fd46-922f-4dc9-8e3c-ef9e0fa39126 for instance 8fa31e02-ef49-475f-9d0d-787e94148547 on hv-cinder-85199 Aug 08 13:48:44.777278 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-3d0fabee-076e-4d73-9429-2c16851919d2 req-046eb25d-338d-4acc-8fa0-a99b38827981 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033370 Aug 08 13:48:44.777877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 495/981] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:48:45.628441 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:45.629068 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:45.636302 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:45.636925 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:45.637545 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:45.638568 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:45.639273 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:45.639747 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:45.672983 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:45.673468 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:45.673893 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:45.674320 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.objects.instance [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lazy-loading 'fault' on Instance uuid 8fa31e02-ef49-475f-9d0d-787e94148547 {{(pid=124407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:48:45.722488 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:45.730210 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-25155752-4a3e-4518-9392-05416ab845e3 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 200 len: 1309 microversion: 2.1 time: 0.105833 Aug 08 13:48:45.740581 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 487/982] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:45 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:48:46.755849 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:46.756744 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8fa31e02-ef49-475f-9d0d-787e94148547] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:46.767011 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:46.767799 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:46.768495 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:46.769586 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:46.770261 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:46.770805 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:46.784406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] HTTP exception thrown: Instance 8fa31e02-ef49-475f-9d0d-787e94148547 could not be found. Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Request method failure captured: Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 HTTP/1.1 Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8RPxp-hrtLOdZM3TKSoxncM11uREjkjgWUMqNDr2nxaEV-d-o0FOTfpGo4DxMc_3S9OlJZPZO1jQDzRcpRd4cepPx7QLBh2YSOGGBDuzeBxOVp9V97PmudwyFEi3nZQZMLZCh2wUN6As26rRf6Y8zVTpXEt1glDj8uyGOXsEQHiYCvk Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 5a479cfd62f048a5aae793d449e9e9d4 Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1129822869 Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:48:46.786025 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a479cfd62f048a5aae793d449e9e9d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a479cfd62f048a5aae793d449e9e9d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a479cfd62f048a5aae793d449e9e9d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a479cfd62f048a5aae793d449e9e9d4"}]}] Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-VolumesSnapshotTestJSON-1129822869 Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 5a479cfd62f048a5aae793d449e9e9d4 Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1129822869 Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-VolumesSnapshotTestJSON-1129822869-project Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: 9cf127f9aa17428bb43df644e17434c6 Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-VolumesSnapshotTestJSON-1129822869-project Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 8fa31e02-ef49-475f-9d0d-787e94148547 could not be found. Aug 08 13:48:46.791685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '8fa31e02-ef49-475f-9d0d-787e94148547'} Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fa31e02-ef49-475f-9d0d-787e94148547 could not be found. Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:48:46.792718 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fa31e02-ef49-475f-9d0d-787e94148547 could not be found. Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fa31e02-ef49-475f-9d0d-787e94148547 could not be found. Aug 08 13:48:46.794133 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:48:46.795393 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Returning 404 to user: Instance 8fa31e02-ef49-475f-9d0d-787e94148547 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:48:46.795393 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c7803300-bcef-441d-a5bc-80a9d770fe8f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547" status: 404 len: 111 microversion: 2.1 time: 0.039482 Aug 08 13:48:46.795393 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 496/983] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:46 2022] GET /compute/v2.1/servers/8fa31e02-ef49-475f-9d0d-787e94148547 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:48:56.757896 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-711762013", "imageRef": "406bb4d3-6830-4c4d-84b8-5394d089e20d", "flavorRef": "452", "networks": [{"uuid": "fffde307-0490-4c62-afd6-dcc616899ac7"}]}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:48:56.767958 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=10 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:56.768582 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:56.817644 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] validate_networks() for [('fffde307-0490-4c62-afd6-dcc616899ac7', None, None, None, None, None)] {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:48:57.299301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:48:57.299750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:48:57.300224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:48:57.300610 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:48:57.301038 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:48:57.311252 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:57.311765 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:57.312174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:57.312918 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:48:57.313367 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:48:57.313792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:48:57.330662 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Getting quotas for project 5a479cfd62f048a5aae793d449e9e9d4. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:48:57.334829 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Getting quotas for user 9cf127f9aa17428bb43df644e17434c6 and project 5a479cfd62f048a5aae793d449e9e9d4. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:48:57.347250 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:48:57.349578 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='406bb4d3-6830-4c4d-84b8-5394d089e20d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:48:57.400699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d8ab0786-8236-4a46-9839-f277f9312ff2 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649269 Aug 08 13:48:57.401363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 488/984] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:48:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:48:57.412742 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b2c8097b-ae90-4352-8ae7-e931d3b78f9e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:57.413369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b2c8097b-ae90-4352-8ae7-e931d3b78f9e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:57.416177 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:57.417181 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:48:57.474024 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-b2c8097b-ae90-4352-8ae7-e931d3b78f9e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:57.481011 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b2c8097b-ae90-4352-8ae7-e931d3b78f9e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1218 microversion: 2.1 time: 0.072464 Aug 08 13:48:57.481562 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 497/985] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:57 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:48:58.502022 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-aedfe84f-ded2-4e05-ac09-5232cb914d2f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:58.502601 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-aedfe84f-ded2-4e05-ac09-5232cb914d2f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:58.555008 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-aedfe84f-ded2-4e05-ac09-5232cb914d2f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:58.566552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-aedfe84f-ded2-4e05-ac09-5232cb914d2f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1218 microversion: 2.1 time: 0.068927 Aug 08 13:48:58.567394 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 489/986] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:58 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:48:59.589325 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c1bb577c-e941-44f9-be37-58d02c7f860f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:48:59.590142 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c1bb577c-e941-44f9-be37-58d02c7f860f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:48:59.651146 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c1bb577c-e941-44f9-be37-58d02c7f860f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:48:59.658553 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c1bb577c-e941-44f9-be37-58d02c7f860f tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1218 microversion: 2.1 time: 0.074336 Aug 08 13:48:59.659243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 498/987] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:48:59 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:00.679102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b1624e2f-9f69-49c2-96a2-de74211113ec tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:00.679704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b1624e2f-9f69-49c2-96a2-de74211113ec tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:00.738579 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b1624e2f-9f69-49c2-96a2-de74211113ec tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:00.745599 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b1624e2f-9f69-49c2-96a2-de74211113ec tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1218 microversion: 2.1 time: 0.070452 Aug 08 13:49:00.746167 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 490/988] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:00 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:01.768022 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a4dfe9a4-4791-47bb-9a4d-b82d343c1cb6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:01.768665 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a4dfe9a4-4791-47bb-9a4d-b82d343c1cb6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:01.775740 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a4dfe9a4-4791-47bb-9a4d-b82d343c1cb6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:01.776280 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a4dfe9a4-4791-47bb-9a4d-b82d343c1cb6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:01.776732 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a4dfe9a4-4791-47bb-9a4d-b82d343c1cb6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:01.777634 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a4dfe9a4-4791-47bb-9a4d-b82d343c1cb6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:01.778129 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a4dfe9a4-4791-47bb-9a4d-b82d343c1cb6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:01.778502 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a4dfe9a4-4791-47bb-9a4d-b82d343c1cb6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:01.840647 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a4dfe9a4-4791-47bb-9a4d-b82d343c1cb6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:01.849125 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a4dfe9a4-4791-47bb-9a4d-b82d343c1cb6 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1222 microversion: 2.1 time: 0.085133 Aug 08 13:49:01.849710 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 499/989] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:01 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:02.875792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e030ba98-e9bc-4515-a255-590333b54ede tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:02.876488 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e030ba98-e9bc-4515-a255-590333b54ede tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:02.883351 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e030ba98-e9bc-4515-a255-590333b54ede tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:02.883871 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e030ba98-e9bc-4515-a255-590333b54ede tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:02.884308 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e030ba98-e9bc-4515-a255-590333b54ede tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:02.885001 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e030ba98-e9bc-4515-a255-590333b54ede tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:02.885449 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e030ba98-e9bc-4515-a255-590333b54ede tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:02.885920 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e030ba98-e9bc-4515-a255-590333b54ede tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:02.961211 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e030ba98-e9bc-4515-a255-590333b54ede tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:02.969208 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e030ba98-e9bc-4515-a255-590333b54ede tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1276 microversion: 2.1 time: 0.097554 Aug 08 13:49:02.969976 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 491/990] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:02 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:03.832057 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-997f2840-55a5-49a6-a95e-e643c29f28a9 req-1c8b7ea3-8881-4813-a387-0b3544b72e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8328f71c-9e1b-4515-9d83-9bf55d12d0ff", "tag": "459fd7e4-f5f4-4bb5-8661-734289a7fa24"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:49:03.842240 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-997f2840-55a5-49a6-a95e-e643c29f28a9 req-1c8b7ea3-8881-4813-a387-0b3544b72e0c service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:03.842638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-997f2840-55a5-49a6-a95e-e643c29f28a9 req-1c8b7ea3-8881-4813-a387-0b3544b72e0c service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:03.843320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-997f2840-55a5-49a6-a95e-e643c29f28a9 req-1c8b7ea3-8881-4813-a387-0b3544b72e0c service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:03.854801 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-997f2840-55a5-49a6-a95e-e643c29f28a9 req-1c8b7ea3-8881-4813-a387-0b3544b72e0c service nova] Creating event network-changed:459fd7e4-f5f4-4bb5-8661-734289a7fa24 for instance 8328f71c-9e1b-4515-9d83-9bf55d12d0ff on hv-cinder-85199 Aug 08 13:49:03.859996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-997f2840-55a5-49a6-a95e-e643c29f28a9 req-1c8b7ea3-8881-4813-a387-0b3544b72e0c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031707 Aug 08 13:49:03.860626 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 500/991] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:49:03.991245 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1e998ab7-f255-44b3-b189-c8055d8c9a4c tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:03.991932 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1e998ab7-f255-44b3-b189-c8055d8c9a4c tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:03.998940 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1e998ab7-f255-44b3-b189-c8055d8c9a4c tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:03.999452 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1e998ab7-f255-44b3-b189-c8055d8c9a4c tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:03.999877 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1e998ab7-f255-44b3-b189-c8055d8c9a4c tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:04.000576 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1e998ab7-f255-44b3-b189-c8055d8c9a4c tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:04.001024 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1e998ab7-f255-44b3-b189-c8055d8c9a4c tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:04.001436 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1e998ab7-f255-44b3-b189-c8055d8c9a4c tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:04.209640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1e998ab7-f255-44b3-b189-c8055d8c9a4c tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:04.217731 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1e998ab7-f255-44b3-b189-c8055d8c9a4c tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1318 microversion: 2.1 time: 0.230615 Aug 08 13:49:04.221494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 492/992] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:03 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:05.239220 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-98a15d98-3be5-43aa-a14c-2324b881f5b8 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:05.239907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-98a15d98-3be5-43aa-a14c-2324b881f5b8 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:05.246682 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-98a15d98-3be5-43aa-a14c-2324b881f5b8 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:05.247204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-98a15d98-3be5-43aa-a14c-2324b881f5b8 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:05.247645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-98a15d98-3be5-43aa-a14c-2324b881f5b8 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:05.248482 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-98a15d98-3be5-43aa-a14c-2324b881f5b8 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:05.248942 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-98a15d98-3be5-43aa-a14c-2324b881f5b8 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:05.249364 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-98a15d98-3be5-43aa-a14c-2324b881f5b8 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:05.384776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-98a15d98-3be5-43aa-a14c-2324b881f5b8 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:05.392580 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-98a15d98-3be5-43aa-a14c-2324b881f5b8 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1318 microversion: 2.1 time: 0.158178 Aug 08 13:49:05.393193 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 501/993] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:05 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:06.415178 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0a0f5063-0d1a-4fa6-89bb-92fe62086be5 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:06.416029 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0a0f5063-0d1a-4fa6-89bb-92fe62086be5 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:06.425869 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0a0f5063-0d1a-4fa6-89bb-92fe62086be5 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:06.426636 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0a0f5063-0d1a-4fa6-89bb-92fe62086be5 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:06.427340 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0a0f5063-0d1a-4fa6-89bb-92fe62086be5 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:06.428359 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0a0f5063-0d1a-4fa6-89bb-92fe62086be5 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:06.428977 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0a0f5063-0d1a-4fa6-89bb-92fe62086be5 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:06.429624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0a0f5063-0d1a-4fa6-89bb-92fe62086be5 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:06.632280 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-0a0f5063-0d1a-4fa6-89bb-92fe62086be5 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:06.641692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0a0f5063-0d1a-4fa6-89bb-92fe62086be5 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1318 microversion: 2.1 time: 0.231575 Aug 08 13:49:06.643044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 493/994] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:06 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:07.664580 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-38365a98-f57b-4dc0-9a92-4f4dabb700ce tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:07.665223 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-38365a98-f57b-4dc0-9a92-4f4dabb700ce tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:07.672021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38365a98-f57b-4dc0-9a92-4f4dabb700ce tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:07.672521 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38365a98-f57b-4dc0-9a92-4f4dabb700ce tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:07.672955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38365a98-f57b-4dc0-9a92-4f4dabb700ce tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:07.673647 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38365a98-f57b-4dc0-9a92-4f4dabb700ce tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:07.674098 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38365a98-f57b-4dc0-9a92-4f4dabb700ce tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:07.674518 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38365a98-f57b-4dc0-9a92-4f4dabb700ce tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:07.809453 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-38365a98-f57b-4dc0-9a92-4f4dabb700ce tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:07.817011 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-38365a98-f57b-4dc0-9a92-4f4dabb700ce tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1318 microversion: 2.1 time: 0.156418 Aug 08 13:49:07.817582 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 502/995] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:07 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:08.844149 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8659ee11-757c-4a5f-a8b1-72c635df670e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:08.844768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8659ee11-757c-4a5f-a8b1-72c635df670e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:08.847852 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:49:08.854492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8659ee11-757c-4a5f-a8b1-72c635df670e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:08.854983 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8659ee11-757c-4a5f-a8b1-72c635df670e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:08.855457 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8659ee11-757c-4a5f-a8b1-72c635df670e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:08.856196 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8659ee11-757c-4a5f-a8b1-72c635df670e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:08.856637 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8659ee11-757c-4a5f-a8b1-72c635df670e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:08.857052 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8659ee11-757c-4a5f-a8b1-72c635df670e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:08.990554 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8659ee11-757c-4a5f-a8b1-72c635df670e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:08.998762 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8659ee11-757c-4a5f-a8b1-72c635df670e tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1318 microversion: 2.1 time: 0.158734 Aug 08 13:49:08.999395 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 494/996] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:08 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:10.024029 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bb25c291-9df4-41d0-9ceb-28825ece79cf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:10.025001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bb25c291-9df4-41d0-9ceb-28825ece79cf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:10.028385 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=4 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:49:10.034104 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb25c291-9df4-41d0-9ceb-28825ece79cf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:10.034581 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb25c291-9df4-41d0-9ceb-28825ece79cf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:10.035014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb25c291-9df4-41d0-9ceb-28825ece79cf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:10.035734 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb25c291-9df4-41d0-9ceb-28825ece79cf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:10.036186 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb25c291-9df4-41d0-9ceb-28825ece79cf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:10.036607 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bb25c291-9df4-41d0-9ceb-28825ece79cf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:10.177484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bb25c291-9df4-41d0-9ceb-28825ece79cf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:10.185788 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bb25c291-9df4-41d0-9ceb-28825ece79cf tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1318 microversion: 2.1 time: 0.168189 Aug 08 13:49:10.186359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 503/997] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:10 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:11.066758 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-6d9dc4b6-e999-4c25-a2ee-82db7ff2af62 req-85ea3db7-4c73-4142-b0ba-f276cf9fa283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8328f71c-9e1b-4515-9d83-9bf55d12d0ff", "name": "network-vif-plugged", "status": "completed", "tag": "459fd7e4-f5f4-4bb5-8661-734289a7fa24"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:49:11.073169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=10 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:49:11.079747 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-6d9dc4b6-e999-4c25-a2ee-82db7ff2af62 req-85ea3db7-4c73-4142-b0ba-f276cf9fa283 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:11.080343 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-6d9dc4b6-e999-4c25-a2ee-82db7ff2af62 req-85ea3db7-4c73-4142-b0ba-f276cf9fa283 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:11.080773 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-6d9dc4b6-e999-4c25-a2ee-82db7ff2af62 req-85ea3db7-4c73-4142-b0ba-f276cf9fa283 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:11.092195 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-6d9dc4b6-e999-4c25-a2ee-82db7ff2af62 req-85ea3db7-4c73-4142-b0ba-f276cf9fa283 service nova] Creating event network-vif-plugged:459fd7e4-f5f4-4bb5-8661-734289a7fa24 for instance 8328f71c-9e1b-4515-9d83-9bf55d12d0ff on hv-cinder-85199 Aug 08 13:49:11.097567 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-6d9dc4b6-e999-4c25-a2ee-82db7ff2af62 req-85ea3db7-4c73-4142-b0ba-f276cf9fa283 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034590 Aug 08 13:49:11.098123 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 495/998] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:49:11.206879 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5674e6e3-44de-430c-b351-c45e9ef58e62 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:11.207754 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-5674e6e3-44de-430c-b351-c45e9ef58e62 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:11.214336 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5674e6e3-44de-430c-b351-c45e9ef58e62 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:11.214828 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5674e6e3-44de-430c-b351-c45e9ef58e62 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:11.215266 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5674e6e3-44de-430c-b351-c45e9ef58e62 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:11.215968 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5674e6e3-44de-430c-b351-c45e9ef58e62 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:11.216417 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5674e6e3-44de-430c-b351-c45e9ef58e62 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:11.216835 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5674e6e3-44de-430c-b351-c45e9ef58e62 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:11.408854 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-5674e6e3-44de-430c-b351-c45e9ef58e62 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:11.417969 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-5674e6e3-44de-430c-b351-c45e9ef58e62 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1318 microversion: 2.1 time: 0.215321 Aug 08 13:49:11.418552 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 504/999] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:11 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:12.443423 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1b0fa8a3-151a-4a26-9188-c582a2cccaf1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:12.444142 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1b0fa8a3-151a-4a26-9188-c582a2cccaf1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:12.453672 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1b0fa8a3-151a-4a26-9188-c582a2cccaf1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:12.454343 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1b0fa8a3-151a-4a26-9188-c582a2cccaf1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:12.454967 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1b0fa8a3-151a-4a26-9188-c582a2cccaf1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:12.455981 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1b0fa8a3-151a-4a26-9188-c582a2cccaf1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:12.456579 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1b0fa8a3-151a-4a26-9188-c582a2cccaf1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:12.457167 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1b0fa8a3-151a-4a26-9188-c582a2cccaf1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:12.594467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1b0fa8a3-151a-4a26-9188-c582a2cccaf1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:12.606338 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1b0fa8a3-151a-4a26-9188-c582a2cccaf1 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1318 microversion: 2.1 time: 0.170145 Aug 08 13:49:12.606860 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 496/1000] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:12 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:13.628048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8344df15-50d9-4063-825e-812a869f54f0 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:13.628649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8344df15-50d9-4063-825e-812a869f54f0 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:13.635704 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8344df15-50d9-4063-825e-812a869f54f0 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:13.636258 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8344df15-50d9-4063-825e-812a869f54f0 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:13.636619 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8344df15-50d9-4063-825e-812a869f54f0 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:13.637313 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8344df15-50d9-4063-825e-812a869f54f0 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:13.637787 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8344df15-50d9-4063-825e-812a869f54f0 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:13.638208 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8344df15-50d9-4063-825e-812a869f54f0 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:13.776554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8344df15-50d9-4063-825e-812a869f54f0 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:13.785624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8344df15-50d9-4063-825e-812a869f54f0 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1506 microversion: 2.1 time: 0.161542 Aug 08 13:49:13.786199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 505/1001] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:13 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:13.809137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3396df40-53c6-4c49-a513-8896bb5fb703 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca8058a2-235b-429a-becf-bdd7e7a0c8d0", "device": "/dev/sdb"}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:49:13.812167 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3396df40-53c6-4c49-a513-8896bb5fb703 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:13.818844 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3396df40-53c6-4c49-a513-8896bb5fb703 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:13.819363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3396df40-53c6-4c49-a513-8896bb5fb703 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:13.819759 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3396df40-53c6-4c49-a513-8896bb5fb703 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:13.820441 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3396df40-53c6-4c49-a513-8896bb5fb703 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:13.820918 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3396df40-53c6-4c49-a513-8896bb5fb703 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:13.821328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3396df40-53c6-4c49-a513-8896bb5fb703 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:14.108544 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3396df40-53c6-4c49-a513-8896bb5fb703 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "POST /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305577 Aug 08 13:49:14.109186 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 497/1002] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 13:49:13 2022] POST /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:49:27.325022 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a5fd826d-7d5f-4d8d-ae39-72afb9996aeb tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1924169941"}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:49:27.325664 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a5fd826d-7d5f-4d8d-ae39-72afb9996aeb tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:27.328017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=22 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:49:27.328693 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=38 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:49:27.336250 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5fd826d-7d5f-4d8d-ae39-72afb9996aeb tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:27.337005 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5fd826d-7d5f-4d8d-ae39-72afb9996aeb tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:27.337721 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5fd826d-7d5f-4d8d-ae39-72afb9996aeb tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:27.338669 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5fd826d-7d5f-4d8d-ae39-72afb9996aeb tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:27.339502 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5fd826d-7d5f-4d8d-ae39-72afb9996aeb tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:27.340165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a5fd826d-7d5f-4d8d-ae39-72afb9996aeb tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:27.478351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.network.security_group_api [None req-a5fd826d-7d5f-4d8d-ae39-72afb9996aeb tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Removing security group 728126c7-5938-446e-8c74-61f93dc77730 from port 45702b70-c19c-4c1e-9dba-aa467622e0fa Aug 08 13:49:27.789389 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a5fd826d-7d5f-4d8d-ae39-72afb9996aeb tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "POST /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/action" status: 202 len: 0 microversion: 2.1 time: 0.468519 Aug 08 13:49:27.789998 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 506/1003] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:49:27 2022] POST /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:49:27.797673 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:49:27.798508 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:49:27.803599 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-e1d05603-8346-4b91-a320-05fe89e56ba4 req-96045d98-f9b3-40cd-8ca7-81c12617a957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6e39bb-b46d-411d-a8b7-d72aec249294", "tag": "45702b70-c19c-4c1e-9dba-aa467622e0fa"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:49:27.815547 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-e1d05603-8346-4b91-a320-05fe89e56ba4 req-96045d98-f9b3-40cd-8ca7-81c12617a957 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:27.816025 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-e1d05603-8346-4b91-a320-05fe89e56ba4 req-96045d98-f9b3-40cd-8ca7-81c12617a957 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:27.816442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-e1d05603-8346-4b91-a320-05fe89e56ba4 req-96045d98-f9b3-40cd-8ca7-81c12617a957 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:27.830833 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-e1d05603-8346-4b91-a320-05fe89e56ba4 req-96045d98-f9b3-40cd-8ca7-81c12617a957 service nova] Creating event network-changed:45702b70-c19c-4c1e-9dba-aa467622e0fa for instance cd6e39bb-b46d-411d-a8b7-d72aec249294 on hv-cinder-85199 Aug 08 13:49:27.836428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-e1d05603-8346-4b91-a320-05fe89e56ba4 req-96045d98-f9b3-40cd-8ca7-81c12617a957 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040100 Aug 08 13:49:27.837005 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 498/1004] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:49:29.037434 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-b95825ff-ba7f-4fdd-b132-134b9cdf20c9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:29.038007 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-b95825ff-ba7f-4fdd-b132-134b9cdf20c9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:29.046754 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b95825ff-ba7f-4fdd-b132-134b9cdf20c9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:29.047533 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b95825ff-ba7f-4fdd-b132-134b9cdf20c9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:29.047966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b95825ff-ba7f-4fdd-b132-134b9cdf20c9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:29.048644 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b95825ff-ba7f-4fdd-b132-134b9cdf20c9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:29.049301 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b95825ff-ba7f-4fdd-b132-134b9cdf20c9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:29.049866 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-b95825ff-ba7f-4fdd-b132-134b9cdf20c9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:29.134529 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-b95825ff-ba7f-4fdd-b132-134b9cdf20c9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lazy-loading 'services' on Instance uuid cd6e39bb-b46d-411d-a8b7-d72aec249294 {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:49:29.177703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-7310aa53-517f-47a2-a7d2-ae98fc182196 req-4b885840-5cdc-4045-a63b-5090b9860bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6e39bb-b46d-411d-a8b7-d72aec249294", "tag": "45702b70-c19c-4c1e-9dba-aa467622e0fa"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:49:29.187935 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-7310aa53-517f-47a2-a7d2-ae98fc182196 req-4b885840-5cdc-4045-a63b-5090b9860bb2 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:29.188623 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-7310aa53-517f-47a2-a7d2-ae98fc182196 req-4b885840-5cdc-4045-a63b-5090b9860bb2 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:29.189263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-7310aa53-517f-47a2-a7d2-ae98fc182196 req-4b885840-5cdc-4045-a63b-5090b9860bb2 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:29.202825 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-7310aa53-517f-47a2-a7d2-ae98fc182196 req-4b885840-5cdc-4045-a63b-5090b9860bb2 service nova] Creating event network-changed:45702b70-c19c-4c1e-9dba-aa467622e0fa for instance cd6e39bb-b46d-411d-a8b7-d72aec249294 on hv-cinder-85199 Aug 08 13:49:29.208638 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-7310aa53-517f-47a2-a7d2-ae98fc182196 req-4b885840-5cdc-4045-a63b-5090b9860bb2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173029 Aug 08 13:49:29.209301 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 499/1005] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:49:29.219979 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-b95825ff-ba7f-4fdd-b132-134b9cdf20c9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments/adc8c2d6-e6cc-43b8-842d-d1b27079dfa0" status: 202 len: 0 microversion: 2.1 time: 0.187115 Aug 08 13:49:29.220637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 507/1006] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:49:29 2022] DELETE /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments/adc8c2d6-e6cc-43b8-842d-d1b27079dfa0 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:49:29.230103 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5487c8e1-e780-433c-9d73-6f9180dcdbf9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:29.232537 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5487c8e1-e780-433c-9d73-6f9180dcdbf9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:29.240757 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5487c8e1-e780-433c-9d73-6f9180dcdbf9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:29.241246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5487c8e1-e780-433c-9d73-6f9180dcdbf9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:29.241683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5487c8e1-e780-433c-9d73-6f9180dcdbf9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:29.242387 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5487c8e1-e780-433c-9d73-6f9180dcdbf9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:29.242835 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5487c8e1-e780-433c-9d73-6f9180dcdbf9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:29.243287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5487c8e1-e780-433c-9d73-6f9180dcdbf9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:29.275491 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5487c8e1-e780-433c-9d73-6f9180dcdbf9 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049707 Aug 08 13:49:29.279260 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 500/1007] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:49:29 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:49:30.288565 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-63119832-d15c-4202-ae00-3f05f2ec4c94 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:30.290962 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-63119832-d15c-4202-ae00-3f05f2ec4c94 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:30.297892 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63119832-d15c-4202-ae00-3f05f2ec4c94 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:30.298372 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63119832-d15c-4202-ae00-3f05f2ec4c94 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:30.298799 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63119832-d15c-4202-ae00-3f05f2ec4c94 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:30.299511 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63119832-d15c-4202-ae00-3f05f2ec4c94 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:30.299934 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63119832-d15c-4202-ae00-3f05f2ec4c94 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:30.305598 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-63119832-d15c-4202-ae00-3f05f2ec4c94 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:30.329781 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-63119832-d15c-4202-ae00-3f05f2ec4c94 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045354 Aug 08 13:49:30.330355 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 508/1008] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:49:30 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:49:31.344094 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-edc519bf-016a-4b33-96be-408b44434808 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:31.346732 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-edc519bf-016a-4b33-96be-408b44434808 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:31.353995 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-edc519bf-016a-4b33-96be-408b44434808 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:31.354478 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-edc519bf-016a-4b33-96be-408b44434808 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:31.354910 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-edc519bf-016a-4b33-96be-408b44434808 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:31.355635 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-edc519bf-016a-4b33-96be-408b44434808 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:31.356080 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-edc519bf-016a-4b33-96be-408b44434808 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:31.356534 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-edc519bf-016a-4b33-96be-408b44434808 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:31.386920 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-edc519bf-016a-4b33-96be-408b44434808 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046894 Aug 08 13:49:31.387538 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 501/1009] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:49:31 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:49:32.400340 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bd5e4576-f7e4-4178-a4f0-ac0fc5a3c75c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:32.402661 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bd5e4576-f7e4-4178-a4f0-ac0fc5a3c75c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:32.409971 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd5e4576-f7e4-4178-a4f0-ac0fc5a3c75c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:32.410475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd5e4576-f7e4-4178-a4f0-ac0fc5a3c75c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:32.410914 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd5e4576-f7e4-4178-a4f0-ac0fc5a3c75c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:32.411679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd5e4576-f7e4-4178-a4f0-ac0fc5a3c75c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:32.412130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd5e4576-f7e4-4178-a4f0-ac0fc5a3c75c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:32.412557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bd5e4576-f7e4-4178-a4f0-ac0fc5a3c75c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:32.446651 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bd5e4576-f7e4-4178-a4f0-ac0fc5a3c75c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050536 Aug 08 13:49:32.447329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 509/1010] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:49:32 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:49:33.460719 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1bee832c-e8e9-45dc-82f9-059790008298 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:33.462997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1bee832c-e8e9-45dc-82f9-059790008298 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:33.470239 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bee832c-e8e9-45dc-82f9-059790008298 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:33.470801 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bee832c-e8e9-45dc-82f9-059790008298 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:33.471614 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bee832c-e8e9-45dc-82f9-059790008298 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:33.472310 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bee832c-e8e9-45dc-82f9-059790008298 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:33.472757 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bee832c-e8e9-45dc-82f9-059790008298 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:33.473206 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bee832c-e8e9-45dc-82f9-059790008298 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:33.504642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1bee832c-e8e9-45dc-82f9-059790008298 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047971 Aug 08 13:49:33.505298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 502/1011] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 13:49:33 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 13:49:33.518612 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:33.519244 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:33.526157 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:33.526702 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:33.527147 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:33.527877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:33.528325 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:33.528737 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:33.610122 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] HTTP exception thrown: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 is not attached to volume adc8c2d6-e6cc-43b8-842d-d1b27079dfa0 Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Request method failure captured: Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: DELETE /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments/adc8c2d6-e6cc-43b8-842d-d1b27079dfa0 HTTP/1.1 Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8ROA71iTFJJJOeScNFyyRC6naihyM5aKrZdLS17QcpwEhtUU0kMNGq4Q7NhHPCzs33wye3Er4Y7ZnJKK78jAXutctcpeeUVwsOO5RqOZXLUAX7p0PYpxaOnJwZP2-9udbxO1OZlYauzEMae5clRCiPHyioIAUT1AII1E2rh-nMkCRWo Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: 554bfc93b1a44d57a5e8e5868cd2eed6 Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-TestMinimumBasicScenario-1848430547 Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:49:33.612435 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/554bfc93b1a44d57a5e8e5868cd2eed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_554bfc93b1a44d57a5e8e5868cd2eed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/554bfc93b1a44d57a5e8e5868cd2eed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/554bfc93b1a44d57a5e8e5868cd2eed6"}]}] Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-TestMinimumBasicScenario-1848430547 Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: 554bfc93b1a44d57a5e8e5868cd2eed6 Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1848430547 Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-TestMinimumBasicScenario-1848430547-project Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: 14aab8af2e6b4201b0951199de8156e8 Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-TestMinimumBasicScenario-1848430547-project Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:49:33.614406 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 is not attached to volume adc8c2d6-e6cc-43b8-842d-d1b27079dfa0 Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'server_id': 'cd6e39bb-b46d-411d-a8b7-d72aec249294', 'id': 'adc8c2d6-e6cc-43b8-842d-d1b27079dfa0'} Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id adc8c2d6-e6cc-43b8-842d-d1b27079dfa0. Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:49:33.615305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 is not attached to volume adc8c2d6-e6cc-43b8-842d-d1b27079dfa0 Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 is not attached to volume adc8c2d6-e6cc-43b8-842d-d1b27079dfa0 Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:49:33.616907 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Returning 404 to user: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 is not attached to volume adc8c2d6-e6cc-43b8-842d-d1b27079dfa0 {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:49:33.618836 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f8a50f2e-c441-4191-8872-4904be8d8a4c tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments/adc8c2d6-e6cc-43b8-842d-d1b27079dfa0" status: 404 len: 154 microversion: 2.1 time: 0.099453 Aug 08 13:49:33.618836 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 510/1012] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:49:33 2022] DELETE /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294/os-volume_attachments/adc8c2d6-e6cc-43b8-842d-d1b27079dfa0 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:49:34.770862 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8a82a772-ffb5-4f77-9024-3b76073db9f2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:34.771490 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8a82a772-ffb5-4f77-9024-3b76073db9f2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:34.779224 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a82a772-ffb5-4f77-9024-3b76073db9f2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:34.779706 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a82a772-ffb5-4f77-9024-3b76073db9f2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:34.780125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a82a772-ffb5-4f77-9024-3b76073db9f2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:34.780826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a82a772-ffb5-4f77-9024-3b76073db9f2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:34.781303 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a82a772-ffb5-4f77-9024-3b76073db9f2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:34.781663 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8a82a772-ffb5-4f77-9024-3b76073db9f2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:34.809498 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8a82a772-ffb5-4f77-9024-3b76073db9f2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:49:34.897501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8a82a772-ffb5-4f77-9024-3b76073db9f2 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 204 len: 0 microversion: 2.1 time: 0.129676 Aug 08 13:49:34.898000 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 503/1013] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:49:34 2022] DELETE /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:49:34.906716 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d5f08b6d-9dc0-4570-af20-3c88f5dd3db7 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:34.907348 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d5f08b6d-9dc0-4570-af20-3c88f5dd3db7 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:34.913731 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5f08b6d-9dc0-4570-af20-3c88f5dd3db7 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:34.914204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5f08b6d-9dc0-4570-af20-3c88f5dd3db7 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:34.914640 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5f08b6d-9dc0-4570-af20-3c88f5dd3db7 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:34.915349 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5f08b6d-9dc0-4570-af20-3c88f5dd3db7 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:34.915798 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5f08b6d-9dc0-4570-af20-3c88f5dd3db7 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:34.916225 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d5f08b6d-9dc0-4570-af20-3c88f5dd3db7 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:35.058278 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d5f08b6d-9dc0-4570-af20-3c88f5dd3db7 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:35.066240 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d5f08b6d-9dc0-4570-af20-3c88f5dd3db7 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1554 microversion: 2.1 time: 0.163667 Aug 08 13:49:35.066812 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 511/1014] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:34 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:36.094664 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-eed65581-d36b-404a-9553-d54141dcd6d3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:36.095364 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-eed65581-d36b-404a-9553-d54141dcd6d3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:36.102530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eed65581-d36b-404a-9553-d54141dcd6d3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:36.103005 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eed65581-d36b-404a-9553-d54141dcd6d3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:36.103501 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eed65581-d36b-404a-9553-d54141dcd6d3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:36.104187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eed65581-d36b-404a-9553-d54141dcd6d3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:36.104635 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eed65581-d36b-404a-9553-d54141dcd6d3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:36.105053 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eed65581-d36b-404a-9553-d54141dcd6d3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:36.243668 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-eed65581-d36b-404a-9553-d54141dcd6d3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:36.251366 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-eed65581-d36b-404a-9553-d54141dcd6d3 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1554 microversion: 2.1 time: 0.161152 Aug 08 13:49:36.251927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 504/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:36 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:36.932473 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a3704dd9-8044-4cf2-883e-bc2808999c91 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:36.933031 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a3704dd9-8044-4cf2-883e-bc2808999c91 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:36.939691 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3704dd9-8044-4cf2-883e-bc2808999c91 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:36.940168 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3704dd9-8044-4cf2-883e-bc2808999c91 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:36.940601 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3704dd9-8044-4cf2-883e-bc2808999c91 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:36.941282 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3704dd9-8044-4cf2-883e-bc2808999c91 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:36.941731 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3704dd9-8044-4cf2-883e-bc2808999c91 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:36.942148 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a3704dd9-8044-4cf2-883e-bc2808999c91 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:37.037878 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-a3704dd9-8044-4cf2-883e-bc2808999c91 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lazy-loading 'services' on Instance uuid 8328f71c-9e1b-4515-9d83-9bf55d12d0ff {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:49:37.123592 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a3704dd9-8044-4cf2-883e-bc2808999c91 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff/os-volume_attachments/ca8058a2-235b-429a-becf-bdd7e7a0c8d0" status: 202 len: 0 microversion: 2.1 time: 0.194645 Aug 08 13:49:37.124200 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 512/1016] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 13:49:36 2022] DELETE /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff/os-volume_attachments/ca8058a2-235b-429a-becf-bdd7e7a0c8d0 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:49:37.272589 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4377cf35-8f73-4c01-8fb7-3e184dc5a88a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:37.273189 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4377cf35-8f73-4c01-8fb7-3e184dc5a88a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:37.279894 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4377cf35-8f73-4c01-8fb7-3e184dc5a88a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:37.280374 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4377cf35-8f73-4c01-8fb7-3e184dc5a88a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:37.280803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4377cf35-8f73-4c01-8fb7-3e184dc5a88a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:37.281496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4377cf35-8f73-4c01-8fb7-3e184dc5a88a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:37.281941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4377cf35-8f73-4c01-8fb7-3e184dc5a88a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:37.282332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4377cf35-8f73-4c01-8fb7-3e184dc5a88a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:37.509564 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4377cf35-8f73-4c01-8fb7-3e184dc5a88a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aab8af2e6b4201b0951199de8156e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554bfc93b1a44d57a5e8e5868cd2eed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:37.517920 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4377cf35-8f73-4c01-8fb7-3e184dc5a88a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 200 len: 1554 microversion: 2.1 time: 0.249327 Aug 08 13:49:37.518490 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 505/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:37 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:37.702770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-61625971-15d1-49d0-8cce-13b35370e328 req-64c25d28-e323-438f-a7a1-4a58fa0c846b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6e39bb-b46d-411d-a8b7-d72aec249294", "name": "network-vif-deleted", "tag": "45702b70-c19c-4c1e-9dba-aa467622e0fa"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:49:37.713650 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-61625971-15d1-49d0-8cce-13b35370e328 req-64c25d28-e323-438f-a7a1-4a58fa0c846b service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:37.714130 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-61625971-15d1-49d0-8cce-13b35370e328 req-64c25d28-e323-438f-a7a1-4a58fa0c846b service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:37.714554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-61625971-15d1-49d0-8cce-13b35370e328 req-64c25d28-e323-438f-a7a1-4a58fa0c846b service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:37.726853 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-61625971-15d1-49d0-8cce-13b35370e328 req-64c25d28-e323-438f-a7a1-4a58fa0c846b service nova] Creating event network-vif-deleted:45702b70-c19c-4c1e-9dba-aa467622e0fa for instance cd6e39bb-b46d-411d-a8b7-d72aec249294 on hv-cinder-85199 Aug 08 13:49:37.735118 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-61625971-15d1-49d0-8cce-13b35370e328 req-64c25d28-e323-438f-a7a1-4a58fa0c846b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036310 Aug 08 13:49:37.735960 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 513/1018] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:49:38.255381 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8fc1bb18-e78f-4b74-abcb-bee8199165ac tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:38.256109 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8fc1bb18-e78f-4b74-abcb-bee8199165ac tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:38.264502 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8fc1bb18-e78f-4b74-abcb-bee8199165ac tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:38.264987 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8fc1bb18-e78f-4b74-abcb-bee8199165ac tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:38.265413 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8fc1bb18-e78f-4b74-abcb-bee8199165ac tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:38.266182 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8fc1bb18-e78f-4b74-abcb-bee8199165ac tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:38.266694 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8fc1bb18-e78f-4b74-abcb-bee8199165ac tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:38.267115 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8fc1bb18-e78f-4b74-abcb-bee8199165ac tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:38.296605 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8fc1bb18-e78f-4b74-abcb-bee8199165ac tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:49:38.395853 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8fc1bb18-e78f-4b74-abcb-bee8199165ac tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 204 len: 0 microversion: 2.1 time: 0.146069 Aug 08 13:49:38.399132 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 506/1019] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:49:38 2022] DELETE /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:49:38.408532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-833d94fe-adcd-4755-b601-f551e3cf183b tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:38.409327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-833d94fe-adcd-4755-b601-f551e3cf183b tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:38.416472 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-833d94fe-adcd-4755-b601-f551e3cf183b tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:38.417367 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-833d94fe-adcd-4755-b601-f551e3cf183b tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:38.417850 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-833d94fe-adcd-4755-b601-f551e3cf183b tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:38.418563 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-833d94fe-adcd-4755-b601-f551e3cf183b tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:38.419024 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-833d94fe-adcd-4755-b601-f551e3cf183b tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:38.419554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-833d94fe-adcd-4755-b601-f551e3cf183b tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:38.539964 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:38.540915 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] [instance: cd6e39bb-b46d-411d-a8b7-d72aec249294] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:38.547377 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:38.547869 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:38.548298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:38.549008 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:38.549453 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:38.549873 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:38.565260 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] HTTP exception thrown: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 could not be found. Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Request method failure captured: Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 HTTP/1.1 Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8ROA71iTFJJJOeScNFyyRC6naihyM5aKrZdLS17QcpwEhtUU0kMNGq4Q7NhHPCzs33wye3Er4Y7ZnJKK78jAXutctcpeeUVwsOO5RqOZXLUAX7p0PYpxaOnJwZP2-9udbxO1OZlYauzEMae5clRCiPHyioIAUT1AII1E2rh-nMkCRWo Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 554bfc93b1a44d57a5e8e5868cd2eed6 Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-TestMinimumBasicScenario-1848430547 Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:49:38.567154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/554bfc93b1a44d57a5e8e5868cd2eed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_554bfc93b1a44d57a5e8e5868cd2eed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/554bfc93b1a44d57a5e8e5868cd2eed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/554bfc93b1a44d57a5e8e5868cd2eed6"}]}] Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-TestMinimumBasicScenario-1848430547 Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 554bfc93b1a44d57a5e8e5868cd2eed6 Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1848430547 Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-TestMinimumBasicScenario-1848430547-project Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: 14aab8af2e6b4201b0951199de8156e8 Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-TestMinimumBasicScenario-1848430547-project Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 could not be found. Aug 08 13:49:38.569683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': 'cd6e39bb-b46d-411d-a8b7-d72aec249294'} Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 could not be found. Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:49:38.572201 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 could not be found. Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 could not be found. Aug 08 13:49:38.576328 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:49:38.578948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Returning 404 to user: Instance cd6e39bb-b46d-411d-a8b7-d72aec249294 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:49:38.578948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-22cc21a8-9674-4d10-9d0c-602f72700f71 tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294" status: 404 len: 111 microversion: 2.1 time: 0.033041 Aug 08 13:49:38.578948 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 507/1020] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:38 2022] GET /compute/v2.1/servers/cd6e39bb-b46d-411d-a8b7-d72aec249294 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 13:49:38.588750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2c379de1-eb82-40e0-b8ce-c0331e8cae2a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] Calling method '.version_select at 0x7f7d2414ba60>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:38.593398 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-833d94fe-adcd-4755-b601-f551e3cf183b tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:38.602955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-833d94fe-adcd-4755-b601-f551e3cf183b tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1512 microversion: 2.1 time: 0.199440 Aug 08 13:49:38.603604 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 514/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:38 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:38.621112 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2c379de1-eb82-40e0-b8ce-c0331e8cae2a tempest-TestMinimumBasicScenario-1848430547 tempest-TestMinimumBasicScenario-1848430547-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1085035743" status: 202 len: 0 microversion: 2.1 time: 0.039721 Aug 08 13:49:38.621706 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 508/1022] 10.222.0.33 () {58 vars in 1272 bytes} [Mon Aug 8 13:49:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1085035743 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:49:39.625568 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3abc789b-f6c9-466e-90f4-390e79d4f763 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:39.626144 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3abc789b-f6c9-466e-90f4-390e79d4f763 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:39.633011 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3abc789b-f6c9-466e-90f4-390e79d4f763 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:39.633490 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3abc789b-f6c9-466e-90f4-390e79d4f763 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:39.633944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3abc789b-f6c9-466e-90f4-390e79d4f763 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:39.634623 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3abc789b-f6c9-466e-90f4-390e79d4f763 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:39.635092 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3abc789b-f6c9-466e-90f4-390e79d4f763 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:39.635522 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3abc789b-f6c9-466e-90f4-390e79d4f763 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:39.795359 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3abc789b-f6c9-466e-90f4-390e79d4f763 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:39.810022 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3abc789b-f6c9-466e-90f4-390e79d4f763 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1512 microversion: 2.1 time: 0.188000 Aug 08 13:49:39.811061 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 515/1023] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:39 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:40.836363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5a6ebffe-a405-49b1-aecb-77f5b6476980 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:40.838649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5a6ebffe-a405-49b1-aecb-77f5b6476980 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:40.851207 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a6ebffe-a405-49b1-aecb-77f5b6476980 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:40.852693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a6ebffe-a405-49b1-aecb-77f5b6476980 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:40.853647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a6ebffe-a405-49b1-aecb-77f5b6476980 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:40.855108 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a6ebffe-a405-49b1-aecb-77f5b6476980 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:40.856082 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a6ebffe-a405-49b1-aecb-77f5b6476980 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:40.856957 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a6ebffe-a405-49b1-aecb-77f5b6476980 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:40.968961 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5a6ebffe-a405-49b1-aecb-77f5b6476980 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf127f9aa17428bb43df644e17434c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a479cfd62f048a5aae793d449e9e9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:49:40.983759 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-317167ed-e4f4-429b-8d75-6b31e58d54c8 req-96661ded-45ce-4dca-b910-fea8c86faaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8328f71c-9e1b-4515-9d83-9bf55d12d0ff", "name": "network-vif-deleted", "tag": "459fd7e4-f5f4-4bb5-8661-734289a7fa24"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:49:40.989154 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5a6ebffe-a405-49b1-aecb-77f5b6476980 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 200 len: 1470 microversion: 2.1 time: 0.158329 Aug 08 13:49:40.990683 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 509/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:40 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:49:40.996771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-317167ed-e4f4-429b-8d75-6b31e58d54c8 req-96661ded-45ce-4dca-b910-fea8c86faaab service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:40.997248 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-317167ed-e4f4-429b-8d75-6b31e58d54c8 req-96661ded-45ce-4dca-b910-fea8c86faaab service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:40.997668 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-317167ed-e4f4-429b-8d75-6b31e58d54c8 req-96661ded-45ce-4dca-b910-fea8c86faaab service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:41.022888 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-317167ed-e4f4-429b-8d75-6b31e58d54c8 req-96661ded-45ce-4dca-b910-fea8c86faaab service nova] Creating event network-vif-deleted:459fd7e4-f5f4-4bb5-8661-734289a7fa24 for instance 8328f71c-9e1b-4515-9d83-9bf55d12d0ff on hv-cinder-85199 Aug 08 13:49:41.033531 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-317167ed-e4f4-429b-8d75-6b31e58d54c8 req-96661ded-45ce-4dca-b910-fea8c86faaab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053322 Aug 08 13:49:41.034197 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 516/1025] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:49:42.012255 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:49:42.013495 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] [instance: 8328f71c-9e1b-4515-9d83-9bf55d12d0ff] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:49:42.021642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:42.022322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:42.022747 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:42.023998 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:49:42.024499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:49:42.024951 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:49:42.044354 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] HTTP exception thrown: Instance 8328f71c-9e1b-4515-9d83-9bf55d12d0ff could not be found. Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Request method failure captured: Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff HTTP/1.1 Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8RPxp-hrtLOdZM3TKSoxncM11uREjkjgWUMqNDr2nxaEV-d-o0FOTfpGo4DxMc_3S9OlJZPZO1jQDzRcpRd4cepPx7QLBh2YSOGGBDuzeBxOVp9V97PmudwyFEi3nZQZMLZCh2wUN6As26rRf6Y8zVTpXEt1glDj8uyGOXsEQHiYCvk Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: 5a479cfd62f048a5aae793d449e9e9d4 Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1129822869 Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:49:42.049356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a479cfd62f048a5aae793d449e9e9d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a479cfd62f048a5aae793d449e9e9d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a479cfd62f048a5aae793d449e9e9d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a479cfd62f048a5aae793d449e9e9d4"}]}] Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-VolumesSnapshotTestJSON-1129822869 Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: 5a479cfd62f048a5aae793d449e9e9d4 Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1129822869 Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-VolumesSnapshotTestJSON-1129822869-project Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: 9cf127f9aa17428bb43df644e17434c6 Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-VolumesSnapshotTestJSON-1129822869-project Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 8328f71c-9e1b-4515-9d83-9bf55d12d0ff could not be found. Aug 08 13:49:42.050934 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '8328f71c-9e1b-4515-9d83-9bf55d12d0ff'} Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8328f71c-9e1b-4515-9d83-9bf55d12d0ff could not be found. Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:49:42.051821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8328f71c-9e1b-4515-9d83-9bf55d12d0ff could not be found. Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8328f71c-9e1b-4515-9d83-9bf55d12d0ff could not be found. Aug 08 13:49:42.053341 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:49:42.055071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] Returning 404 to user: Instance 8328f71c-9e1b-4515-9d83-9bf55d12d0ff could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:49:42.055071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1bc04c6d-2b2b-4565-9661-a14ac112e417 tempest-VolumesSnapshotTestJSON-1129822869 tempest-VolumesSnapshotTestJSON-1129822869-project] 10.222.0.33 "GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff" status: 404 len: 111 microversion: 2.1 time: 0.042328 Aug 08 13:49:42.055751 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 510/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:49:42 2022] GET /compute/v2.1/servers/8328f71c-9e1b-4515-9d83-9bf55d12d0ff => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:49:59.211360 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=22 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:49:59.212175 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:49:59.460017 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-696e1643-e359-4b16-b4b1-6a69e7fec466 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Action: 'create', calling method: .version_select at 0x7f7d2441b820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1648947255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYRgJ57v0M9HuHrQBnArQkjQLEYEtWSof6k4n2V/9gsj2ZOVIi05NRgUECiC4hUee2xY8cVUqWju0YK0rlM6e/KxJ9JwfRhLt/z9PgSZgyd0DP3dinwaZr+Rvj50NaxXw=="}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:49:59.479728 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-696e1643-e359-4b16-b4b1-6a69e7fec466 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Getting quotas for project a019b128831a47b7996b3d3e9d6e5652. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:49:59.484454 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-696e1643-e359-4b16-b4b1-6a69e7fec466 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Getting quotas for user d4bb35df2ffd48bf965425afcdbc42fd and project a019b128831a47b7996b3d3e9d6e5652. Resources: {'key_pairs'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:49:59.498154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-696e1643-e359-4b16-b4b1-6a69e7fec466 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [1ed8dcb1-4aa6-40a3-932b-e6e8126680f0] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 13:50:00.505646 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [None req-696e1643-e359-4b16-b4b1-6a69e7fec466 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [1ed8dcb1-4aa6-40a3-932b-e6e8126680f0] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 48044. Aug 08 13:50:00.521828 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-696e1643-e359-4b16-b4b1-6a69e7fec466 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.317693 Aug 08 13:50:00.528151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 517/1027] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 13:49:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:50:18.562703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:18.564621 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:18.763071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-25029e34-f0c9-48f1-a1ab-8378fd8f4e32 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Action: 'create', calling method: .version_select at 0x7f7d24273e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-2135988892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNK4xG5VUoqa//IR6quPi9HyTse9WAidNWPllpqMExGQ9os6kr6OUH3qUIIbwrpajprdsQ+h3F21OBq3GQSehoBwdG9BibQ/n8MDWrurT/IMI6KoVbcuNDvZ68MQZAiWOA=="}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:50:18.779695 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-25029e34-f0c9-48f1-a1ab-8378fd8f4e32 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Getting quotas for project e6c67730fcf64392b047dd178ee72db8. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:50:18.783820 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-25029e34-f0c9-48f1-a1ab-8378fd8f4e32 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Getting quotas for user 74a63ce39dd942f9abb785d05cbd8c2b and project e6c67730fcf64392b047dd178ee72db8. Resources: {'key_pairs'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:50:18.808226 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-25029e34-f0c9-48f1-a1ab-8378fd8f4e32 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.250478 Aug 08 13:50:18.808977 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 511/1028] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 13:50:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:50:23.576826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=4 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:23.577642 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:23.581991 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-378145078", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1648947255", "security_groups": [{"name": "tempest-secgroup-smoke-981625919"}], "block_device_mapping_v2": [{"uuid": "7d937cda-2cfb-4b8b-b1b9-8f4124560a59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4009b150-c6f5-40ec-8551-113c0a775000"}]}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:50:23.826926 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] validate_networks() for [('4009b150-c6f5-40ec-8551-113c0a775000', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:50:24.643623 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:50:24.644356 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:50:24.644533 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:50:24.644971 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:50:24.645375 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:50:24.657668 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:24.658289 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:24.658582 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:24.659343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:24.659799 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:24.660224 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:24.678023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Getting quotas for project a019b128831a47b7996b3d3e9d6e5652. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:50:24.682189 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Getting quotas for user d4bb35df2ffd48bf965425afcdbc42fd and project a019b128831a47b7996b3d3e9d6e5652. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:50:24.743015 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:50:24.745276 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d937cda-2cfb-4b8b-b1b9-8f4124560a59',volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:50:24.890108 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-35f1a9da-bb3c-4460-915a-5620aa5ec3e0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.314853 Aug 08 13:50:24.890832 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 518/1029] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:50:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:50:24.904346 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1e0af062-8a14-47d0-bb48-6a4cdb773c75 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:24.905140 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1e0af062-8a14-47d0-bb48-6a4cdb773c75 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:25.024693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-1e0af062-8a14-47d0-bb48-6a4cdb773c75 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:25.032807 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1e0af062-8a14-47d0-bb48-6a4cdb773c75 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1094 microversion: 2.1 time: 0.134491 Aug 08 13:50:25.033307 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 512/1030] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:24 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:50:26.059997 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-e26d9ebc-b691-488f-89d8-1b932400b5e3 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:26.060641 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-e26d9ebc-b691-488f-89d8-1b932400b5e3 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:26.070467 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e26d9ebc-b691-488f-89d8-1b932400b5e3 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:26.070948 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e26d9ebc-b691-488f-89d8-1b932400b5e3 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:26.071632 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e26d9ebc-b691-488f-89d8-1b932400b5e3 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:26.072379 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e26d9ebc-b691-488f-89d8-1b932400b5e3 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:26.072836 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e26d9ebc-b691-488f-89d8-1b932400b5e3 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:26.073260 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-e26d9ebc-b691-488f-89d8-1b932400b5e3 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:26.154302 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-e26d9ebc-b691-488f-89d8-1b932400b5e3 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:26.165915 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-e26d9ebc-b691-488f-89d8-1b932400b5e3 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1210 microversion: 2.1 time: 0.115756 Aug 08 13:50:26.166543 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 519/1031] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:26 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:27.189557 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-df8d118f-6f53-416f-a599-3d723583c927 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:27.190492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-df8d118f-6f53-416f-a599-3d723583c927 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:27.198451 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df8d118f-6f53-416f-a599-3d723583c927 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:27.198944 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df8d118f-6f53-416f-a599-3d723583c927 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:27.199454 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df8d118f-6f53-416f-a599-3d723583c927 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:27.200437 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df8d118f-6f53-416f-a599-3d723583c927 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:27.201014 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df8d118f-6f53-416f-a599-3d723583c927 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:27.201474 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-df8d118f-6f53-416f-a599-3d723583c927 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:27.441344 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-df8d118f-6f53-416f-a599-3d723583c927 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:27.449682 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-df8d118f-6f53-416f-a599-3d723583c927 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.265293 Aug 08 13:50:27.450349 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 513/1032] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:27 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:27.608546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-7189cc12-2ec7-4d64-b8c3-9bb48cdf034a req-8aa8e60b-2d60-488c-80d3-5156526ffb71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0608a48e-ce46-4bfa-8ee2-e59a1e6415cc", "tag": "7fb52cdd-3685-47bf-89ea-e901a4a9c57e"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:50:27.620187 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7189cc12-2ec7-4d64-b8c3-9bb48cdf034a req-8aa8e60b-2d60-488c-80d3-5156526ffb71 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:27.620682 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7189cc12-2ec7-4d64-b8c3-9bb48cdf034a req-8aa8e60b-2d60-488c-80d3-5156526ffb71 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:27.621124 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7189cc12-2ec7-4d64-b8c3-9bb48cdf034a req-8aa8e60b-2d60-488c-80d3-5156526ffb71 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:27.634805 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-7189cc12-2ec7-4d64-b8c3-9bb48cdf034a req-8aa8e60b-2d60-488c-80d3-5156526ffb71 service nova] Creating event network-changed:7fb52cdd-3685-47bf-89ea-e901a4a9c57e for instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc on hv-cinder-85199 Aug 08 13:50:27.640171 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-7189cc12-2ec7-4d64-b8c3-9bb48cdf034a req-8aa8e60b-2d60-488c-80d3-5156526ffb71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035328 Aug 08 13:50:27.640777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 520/1033] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:50:28.473345 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-971a0637-000d-48fc-825e-d1913cf50eea tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:28.473939 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-971a0637-000d-48fc-825e-d1913cf50eea tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:28.481729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-971a0637-000d-48fc-825e-d1913cf50eea tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:28.482215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-971a0637-000d-48fc-825e-d1913cf50eea tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:28.482642 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-971a0637-000d-48fc-825e-d1913cf50eea tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:28.483366 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-971a0637-000d-48fc-825e-d1913cf50eea tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:28.483816 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-971a0637-000d-48fc-825e-d1913cf50eea tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:28.484235 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-971a0637-000d-48fc-825e-d1913cf50eea tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:28.628257 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-971a0637-000d-48fc-825e-d1913cf50eea tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:28.636744 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-971a0637-000d-48fc-825e-d1913cf50eea tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.169317 Aug 08 13:50:28.637324 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 514/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:28 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:29.659308 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ed91671e-d23e-4769-956e-f6fde1e0fc95 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:29.660008 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ed91671e-d23e-4769-956e-f6fde1e0fc95 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:29.666797 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed91671e-d23e-4769-956e-f6fde1e0fc95 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:29.667319 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed91671e-d23e-4769-956e-f6fde1e0fc95 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:29.667742 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed91671e-d23e-4769-956e-f6fde1e0fc95 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:29.668443 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed91671e-d23e-4769-956e-f6fde1e0fc95 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:29.668886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed91671e-d23e-4769-956e-f6fde1e0fc95 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:29.669410 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed91671e-d23e-4769-956e-f6fde1e0fc95 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:29.887617 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ed91671e-d23e-4769-956e-f6fde1e0fc95 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:29.895610 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ed91671e-d23e-4769-956e-f6fde1e0fc95 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.241240 Aug 08 13:50:29.896356 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 521/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:29 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:30.917964 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-99ea0cbd-05df-4fdf-b330-dc6c7c02bf4b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:30.918615 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-99ea0cbd-05df-4fdf-b330-dc6c7c02bf4b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:30.925734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-99ea0cbd-05df-4fdf-b330-dc6c7c02bf4b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:30.926230 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-99ea0cbd-05df-4fdf-b330-dc6c7c02bf4b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:30.926686 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-99ea0cbd-05df-4fdf-b330-dc6c7c02bf4b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:30.927483 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-99ea0cbd-05df-4fdf-b330-dc6c7c02bf4b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:30.927964 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-99ea0cbd-05df-4fdf-b330-dc6c7c02bf4b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:30.928426 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-99ea0cbd-05df-4fdf-b330-dc6c7c02bf4b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:31.079204 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-99ea0cbd-05df-4fdf-b330-dc6c7c02bf4b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:31.090020 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-99ea0cbd-05df-4fdf-b330-dc6c7c02bf4b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.176916 Aug 08 13:50:31.090590 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 515/1036] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:30 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:32.111992 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-502c781b-64c5-4336-8c90-a4d2ab589442 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:32.112652 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-502c781b-64c5-4336-8c90-a4d2ab589442 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:32.119361 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-502c781b-64c5-4336-8c90-a4d2ab589442 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:32.119838 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-502c781b-64c5-4336-8c90-a4d2ab589442 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:32.120267 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-502c781b-64c5-4336-8c90-a4d2ab589442 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:32.120955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-502c781b-64c5-4336-8c90-a4d2ab589442 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:32.121403 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-502c781b-64c5-4336-8c90-a4d2ab589442 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:32.121821 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-502c781b-64c5-4336-8c90-a4d2ab589442 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:32.259514 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-502c781b-64c5-4336-8c90-a4d2ab589442 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:32.268691 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-502c781b-64c5-4336-8c90-a4d2ab589442 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.160513 Aug 08 13:50:32.269262 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 522/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:32 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:33.298692 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7d4d11a7-1210-4089-827c-c6a8ef605f1a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:33.299511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7d4d11a7-1210-4089-827c-c6a8ef605f1a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:33.307754 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7d4d11a7-1210-4089-827c-c6a8ef605f1a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:33.308240 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7d4d11a7-1210-4089-827c-c6a8ef605f1a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:33.308673 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7d4d11a7-1210-4089-827c-c6a8ef605f1a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:33.309375 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7d4d11a7-1210-4089-827c-c6a8ef605f1a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:33.309869 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7d4d11a7-1210-4089-827c-c6a8ef605f1a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:33.310288 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7d4d11a7-1210-4089-827c-c6a8ef605f1a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:33.446088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7d4d11a7-1210-4089-827c-c6a8ef605f1a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:33.454219 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7d4d11a7-1210-4089-827c-c6a8ef605f1a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.161406 Aug 08 13:50:33.454818 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 516/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:33 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:34.478050 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a909a803-2024-44cb-9272-569b4fc3a54c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:34.478876 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a909a803-2024-44cb-9272-569b4fc3a54c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:34.485565 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a909a803-2024-44cb-9272-569b4fc3a54c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:34.486035 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a909a803-2024-44cb-9272-569b4fc3a54c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:34.486462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a909a803-2024-44cb-9272-569b4fc3a54c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:34.487180 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a909a803-2024-44cb-9272-569b4fc3a54c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:34.487623 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a909a803-2024-44cb-9272-569b4fc3a54c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:34.488038 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a909a803-2024-44cb-9272-569b4fc3a54c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:34.622120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a909a803-2024-44cb-9272-569b4fc3a54c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:34.634851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a909a803-2024-44cb-9272-569b4fc3a54c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.162056 Aug 08 13:50:34.635484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 523/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:34 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:35.656669 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f99ff4e4-29a1-4d1c-83ff-f3b4d9a59e4e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:35.657363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f99ff4e4-29a1-4d1c-83ff-f3b4d9a59e4e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:35.659681 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:35.665242 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f99ff4e4-29a1-4d1c-83ff-f3b4d9a59e4e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:35.665717 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f99ff4e4-29a1-4d1c-83ff-f3b4d9a59e4e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:35.666140 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f99ff4e4-29a1-4d1c-83ff-f3b4d9a59e4e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:35.666827 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f99ff4e4-29a1-4d1c-83ff-f3b4d9a59e4e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:35.667297 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f99ff4e4-29a1-4d1c-83ff-f3b4d9a59e4e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:35.667748 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f99ff4e4-29a1-4d1c-83ff-f3b4d9a59e4e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:35.838535 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f99ff4e4-29a1-4d1c-83ff-f3b4d9a59e4e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:35.846752 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f99ff4e4-29a1-4d1c-83ff-f3b4d9a59e4e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.194132 Aug 08 13:50:35.847380 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 517/1040] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:35 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:36.868567 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d593ca93-bf5f-4f09-b7ad-542905c5941c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:36.869154 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d593ca93-bf5f-4f09-b7ad-542905c5941c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:36.871114 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:36.871798 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:36.878354 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d593ca93-bf5f-4f09-b7ad-542905c5941c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:36.878830 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d593ca93-bf5f-4f09-b7ad-542905c5941c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:36.879301 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d593ca93-bf5f-4f09-b7ad-542905c5941c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:36.879975 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d593ca93-bf5f-4f09-b7ad-542905c5941c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:36.880448 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d593ca93-bf5f-4f09-b7ad-542905c5941c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:36.880867 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d593ca93-bf5f-4f09-b7ad-542905c5941c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:37.020209 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d593ca93-bf5f-4f09-b7ad-542905c5941c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:37.029768 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d593ca93-bf5f-4f09-b7ad-542905c5941c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.165308 Aug 08 13:50:37.030344 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 524/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:36 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:38.052903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ad5558af-40f5-43de-bc51-0afd29feeb4d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:38.053670 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ad5558af-40f5-43de-bc51-0afd29feeb4d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:38.062071 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad5558af-40f5-43de-bc51-0afd29feeb4d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:38.062668 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad5558af-40f5-43de-bc51-0afd29feeb4d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:38.063259 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad5558af-40f5-43de-bc51-0afd29feeb4d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:38.064128 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad5558af-40f5-43de-bc51-0afd29feeb4d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:38.064715 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad5558af-40f5-43de-bc51-0afd29feeb4d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:38.065188 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad5558af-40f5-43de-bc51-0afd29feeb4d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:38.205960 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ad5558af-40f5-43de-bc51-0afd29feeb4d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:38.213960 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ad5558af-40f5-43de-bc51-0afd29feeb4d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.166140 Aug 08 13:50:38.214524 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 518/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:38 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:38.559204 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-44d11572-e60e-4fd0-881c-a80cfe47597d req-bcb7da49-1875-42f0-9161-e9efbf8fc6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0608a48e-ce46-4bfa-8ee2-e59a1e6415cc", "name": "network-vif-plugged", "status": "completed", "tag": "7fb52cdd-3685-47bf-89ea-e901a4a9c57e"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:50:38.569811 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-44d11572-e60e-4fd0-881c-a80cfe47597d req-bcb7da49-1875-42f0-9161-e9efbf8fc6b9 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:38.570327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-44d11572-e60e-4fd0-881c-a80cfe47597d req-bcb7da49-1875-42f0-9161-e9efbf8fc6b9 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:38.570727 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-44d11572-e60e-4fd0-881c-a80cfe47597d req-bcb7da49-1875-42f0-9161-e9efbf8fc6b9 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:38.582442 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-44d11572-e60e-4fd0-881c-a80cfe47597d req-bcb7da49-1875-42f0-9161-e9efbf8fc6b9 service nova] Creating event network-vif-plugged:7fb52cdd-3685-47bf-89ea-e901a4a9c57e for instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc on hv-cinder-85199 Aug 08 13:50:38.587755 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-44d11572-e60e-4fd0-881c-a80cfe47597d req-bcb7da49-1875-42f0-9161-e9efbf8fc6b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032353 Aug 08 13:50:38.588440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 525/1043] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:50:39.240346 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-cb77db7a-8545-46d8-8625-1cbeccd67114 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:39.241081 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-cb77db7a-8545-46d8-8625-1cbeccd67114 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:39.248600 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb77db7a-8545-46d8-8625-1cbeccd67114 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:39.249082 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb77db7a-8545-46d8-8625-1cbeccd67114 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:39.249517 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb77db7a-8545-46d8-8625-1cbeccd67114 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:39.250212 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb77db7a-8545-46d8-8625-1cbeccd67114 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:39.250660 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb77db7a-8545-46d8-8625-1cbeccd67114 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:39.251170 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb77db7a-8545-46d8-8625-1cbeccd67114 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:39.395483 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-cb77db7a-8545-46d8-8625-1cbeccd67114 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:39.403296 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-cb77db7a-8545-46d8-8625-1cbeccd67114 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.167290 Aug 08 13:50:39.403872 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 519/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:39 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:40.431001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4cfcedb8-0d53-407b-8309-62d58f67719e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:40.432077 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4cfcedb8-0d53-407b-8309-62d58f67719e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:40.441485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4cfcedb8-0d53-407b-8309-62d58f67719e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:40.442875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4cfcedb8-0d53-407b-8309-62d58f67719e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:40.444111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4cfcedb8-0d53-407b-8309-62d58f67719e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:40.445966 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4cfcedb8-0d53-407b-8309-62d58f67719e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:40.447181 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4cfcedb8-0d53-407b-8309-62d58f67719e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:40.448445 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4cfcedb8-0d53-407b-8309-62d58f67719e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:40.603366 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4cfcedb8-0d53-407b-8309-62d58f67719e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:40.614348 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4cfcedb8-0d53-407b-8309-62d58f67719e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1265 microversion: 2.1 time: 0.190775 Aug 08 13:50:40.614971 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 526/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:40 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:41.635244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-eab441a9-87cb-4ab0-a79e-5142905d9e12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:41.635954 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-eab441a9-87cb-4ab0-a79e-5142905d9e12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:41.642462 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eab441a9-87cb-4ab0-a79e-5142905d9e12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:41.642937 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eab441a9-87cb-4ab0-a79e-5142905d9e12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:41.643391 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eab441a9-87cb-4ab0-a79e-5142905d9e12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:41.644080 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eab441a9-87cb-4ab0-a79e-5142905d9e12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:41.644521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eab441a9-87cb-4ab0-a79e-5142905d9e12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:41.644932 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-eab441a9-87cb-4ab0-a79e-5142905d9e12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:41.784041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-eab441a9-87cb-4ab0-a79e-5142905d9e12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:41.796028 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-eab441a9-87cb-4ab0-a79e-5142905d9e12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1451 microversion: 2.1 time: 0.164560 Aug 08 13:50:41.796606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 520/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:41 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:41.816636 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d37bae06-3226-4031-b1e2-d804b071b93e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:41.817557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d37bae06-3226-4031-b1e2-d804b071b93e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:41.824416 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37bae06-3226-4031-b1e2-d804b071b93e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:41.824940 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37bae06-3226-4031-b1e2-d804b071b93e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:41.825379 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37bae06-3226-4031-b1e2-d804b071b93e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:41.826269 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37bae06-3226-4031-b1e2-d804b071b93e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:41.826748 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37bae06-3226-4031-b1e2-d804b071b93e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:41.827188 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d37bae06-3226-4031-b1e2-d804b071b93e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:41.982930 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d37bae06-3226-4031-b1e2-d804b071b93e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:41.993834 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d37bae06-3226-4031-b1e2-d804b071b93e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1451 microversion: 2.1 time: 0.181281 Aug 08 13:50:41.994547 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 527/1047] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:41 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1451 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:43.570483 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-809458229", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2135988892", "security_groups": [{"name": "tempest-secgroup-smoke-203677164"}], "networks": [{"uuid": "286ebd78-1ed6-4adf-b228-aaabe9bd4f45"}], "block_device_mapping_v2": [{"uuid": "9d8d0af4-3bb0-47b2-8cbc-440a8f3d935d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:50:43.687401 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.network.neutron [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] validate_networks() for [('286ebd78-1ed6-4adf-b228-aaabe9bd4f45', None, None, None, None, None)] {{(pid=124407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:50:44.073913 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Flavor limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:50:44.074333 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Image limits 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:50:44.074841 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Flavor pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:50:44.075312 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Image pref 0:0:0 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:50:44.075781 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.virt.hardware [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:50:44.078982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-9a885e27-2717-46db-8dfa-ce484f268f16 req-84233f70-e7b8-48ab-9781-099ef7c92fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0608a48e-ce46-4bfa-8ee2-e59a1e6415cc", "tag": "7fb52cdd-3685-47bf-89ea-e901a4a9c57e"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:50:44.089859 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:44.090497 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:44.090678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-9a885e27-2717-46db-8dfa-ce484f268f16 req-84233f70-e7b8-48ab-9781-099ef7c92fc2 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:44.090936 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:44.091641 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-9a885e27-2717-46db-8dfa-ce484f268f16 req-84233f70-e7b8-48ab-9781-099ef7c92fc2 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:44.091841 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:44.092290 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:44.092633 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-9a885e27-2717-46db-8dfa-ce484f268f16 req-84233f70-e7b8-48ab-9781-099ef7c92fc2 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:44.092766 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:44.105138 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-9a885e27-2717-46db-8dfa-ce484f268f16 req-84233f70-e7b8-48ab-9781-099ef7c92fc2 service nova] Creating event network-changed:7fb52cdd-3685-47bf-89ea-e901a4a9c57e for instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc on hv-cinder-85199 Aug 08 13:50:44.110864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-9a885e27-2717-46db-8dfa-ce484f268f16 req-84233f70-e7b8-48ab-9781-099ef7c92fc2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041897 Aug 08 13:50:44.111799 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 528/1048] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:50:44.114618 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Getting quotas for project e6c67730fcf64392b047dd178ee72db8. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:50:44.119363 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.quota [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Getting quotas for user 74a63ce39dd942f9abb785d05cbd8c2b and project e6c67730fcf64392b047dd178ee72db8. Resources: {'instances', 'ram', 'cores'} {{(pid=124407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:50:44.179969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Going to run 1 instances... {{(pid=124407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:50:44.182494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d8d0af4-3bb0-47b2-8cbc-440a8f3d935d',volume_size=None,volume_type=None)] {{(pid=124407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:50:44.334913 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ad4a6148-d85f-4bee-8ec2-69c5ffbb4794 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.768220 Aug 08 13:50:44.343698 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 521/1049] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:50:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:50:44.349453 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9f5f522c-54b1-4593-b08f-b0be69019f6a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:44.350243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9f5f522c-54b1-4593-b08f-b0be69019f6a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:44.449711 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9f5f522c-54b1-4593-b08f-b0be69019f6a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:44.465510 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9f5f522c-54b1-4593-b08f-b0be69019f6a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1088 microversion: 2.1 time: 0.120453 Aug 08 13:50:44.471243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 529/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:44 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1088 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:50:45.489890 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7837babd-4b18-42d6-8667-539673f2bcf6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:45.490515 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7837babd-4b18-42d6-8667-539673f2bcf6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:45.497988 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7837babd-4b18-42d6-8667-539673f2bcf6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:45.498790 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7837babd-4b18-42d6-8667-539673f2bcf6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:45.499241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7837babd-4b18-42d6-8667-539673f2bcf6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:45.500236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7837babd-4b18-42d6-8667-539673f2bcf6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:45.500704 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7837babd-4b18-42d6-8667-539673f2bcf6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:45.501135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7837babd-4b18-42d6-8667-539673f2bcf6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:45.574894 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7837babd-4b18-42d6-8667-539673f2bcf6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:45.583890 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7837babd-4b18-42d6-8667-539673f2bcf6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1194 microversion: 2.1 time: 0.098035 Aug 08 13:50:45.584545 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 522/1051] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:45 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:46.606121 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c4854503-d51a-4150-835a-c360cef82be5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:46.606952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c4854503-d51a-4150-835a-c360cef82be5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:46.614753 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4854503-d51a-4150-835a-c360cef82be5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:46.615239 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4854503-d51a-4150-835a-c360cef82be5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:46.615637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4854503-d51a-4150-835a-c360cef82be5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:46.616326 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4854503-d51a-4150-835a-c360cef82be5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:46.616767 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4854503-d51a-4150-835a-c360cef82be5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:46.617213 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c4854503-d51a-4150-835a-c360cef82be5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:47.109630 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c4854503-d51a-4150-835a-c360cef82be5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:47.117726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c4854503-d51a-4150-835a-c360cef82be5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.515466 Aug 08 13:50:47.118277 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 530/1052] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:46 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:47.206983 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-1fc484a7-3506-484e-8e10-4e7bd61a48a4 req-6f384655-fe95-48e3-a2f5-cc6c87a14952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d5cf9a-8fbc-48de-82b7-68f7efbb7c57", "tag": "5bef4e62-6ed6-4736-8d16-55194c4c9be2"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:50:47.218291 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-1fc484a7-3506-484e-8e10-4e7bd61a48a4 req-6f384655-fe95-48e3-a2f5-cc6c87a14952 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:47.218772 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-1fc484a7-3506-484e-8e10-4e7bd61a48a4 req-6f384655-fe95-48e3-a2f5-cc6c87a14952 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:47.219236 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-1fc484a7-3506-484e-8e10-4e7bd61a48a4 req-6f384655-fe95-48e3-a2f5-cc6c87a14952 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:47.231440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-1fc484a7-3506-484e-8e10-4e7bd61a48a4 req-6f384655-fe95-48e3-a2f5-cc6c87a14952 service nova] Creating event network-changed:5bef4e62-6ed6-4736-8d16-55194c4c9be2 for instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 on hv-cinder-85199 Aug 08 13:50:47.236772 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-1fc484a7-3506-484e-8e10-4e7bd61a48a4 req-6f384655-fe95-48e3-a2f5-cc6c87a14952 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034356 Aug 08 13:50:47.237415 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 523/1053] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:50:48.140860 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bdac1fb7-a131-4235-8935-123a972d0d51 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:48.141476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bdac1fb7-a131-4235-8935-123a972d0d51 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:48.148929 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bdac1fb7-a131-4235-8935-123a972d0d51 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:48.149423 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bdac1fb7-a131-4235-8935-123a972d0d51 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:48.149845 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bdac1fb7-a131-4235-8935-123a972d0d51 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:48.150536 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bdac1fb7-a131-4235-8935-123a972d0d51 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:48.151001 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bdac1fb7-a131-4235-8935-123a972d0d51 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:48.151444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bdac1fb7-a131-4235-8935-123a972d0d51 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:48.295161 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-bdac1fb7-a131-4235-8935-123a972d0d51 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:48.303400 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bdac1fb7-a131-4235-8935-123a972d0d51 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.166633 Aug 08 13:50:48.304086 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 531/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:48 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:49.328213 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e493682d-d106-4a5c-bb52-e4488bc9f15a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:49.328914 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e493682d-d106-4a5c-bb52-e4488bc9f15a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:49.330987 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:49.337119 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e493682d-d106-4a5c-bb52-e4488bc9f15a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:49.337596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e493682d-d106-4a5c-bb52-e4488bc9f15a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:49.338021 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e493682d-d106-4a5c-bb52-e4488bc9f15a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:49.338710 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e493682d-d106-4a5c-bb52-e4488bc9f15a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:49.339187 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e493682d-d106-4a5c-bb52-e4488bc9f15a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:49.339603 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e493682d-d106-4a5c-bb52-e4488bc9f15a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:49.342653 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=59 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:49.480619 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e493682d-d106-4a5c-bb52-e4488bc9f15a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:49.488572 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e493682d-d106-4a5c-bb52-e4488bc9f15a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.166758 Aug 08 13:50:49.489145 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 524/1055] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:49 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:50.509952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ae689ba1-7321-4032-8f16-8e4f7b431a7c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:50.510483 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ae689ba1-7321-4032-8f16-8e4f7b431a7c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:50.517593 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae689ba1-7321-4032-8f16-8e4f7b431a7c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:50.518080 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae689ba1-7321-4032-8f16-8e4f7b431a7c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:50.518508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae689ba1-7321-4032-8f16-8e4f7b431a7c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:50.519243 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae689ba1-7321-4032-8f16-8e4f7b431a7c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:50.519678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae689ba1-7321-4032-8f16-8e4f7b431a7c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:50.520093 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ae689ba1-7321-4032-8f16-8e4f7b431a7c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:50.664785 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ae689ba1-7321-4032-8f16-8e4f7b431a7c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:50.672648 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ae689ba1-7321-4032-8f16-8e4f7b431a7c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.166794 Aug 08 13:50:50.673224 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 532/1056] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:50 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:51.698180 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5090426b-9349-4a00-8601-738d6c9169a5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:51.699147 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5090426b-9349-4a00-8601-738d6c9169a5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:51.710448 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5090426b-9349-4a00-8601-738d6c9169a5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:51.711318 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5090426b-9349-4a00-8601-738d6c9169a5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:51.712048 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5090426b-9349-4a00-8601-738d6c9169a5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:51.713270 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5090426b-9349-4a00-8601-738d6c9169a5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:51.714080 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5090426b-9349-4a00-8601-738d6c9169a5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:51.714793 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5090426b-9349-4a00-8601-738d6c9169a5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:51.871460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5090426b-9349-4a00-8601-738d6c9169a5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:51.882424 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5090426b-9349-4a00-8601-738d6c9169a5 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.190768 Aug 08 13:50:51.883228 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 525/1057] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:51 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:52.906111 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c5c0b142-b7e7-4aea-9623-b1bed482e13a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:52.906887 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c5c0b142-b7e7-4aea-9623-b1bed482e13a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:52.914388 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c0b142-b7e7-4aea-9623-b1bed482e13a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:52.914875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c0b142-b7e7-4aea-9623-b1bed482e13a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:52.915342 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c0b142-b7e7-4aea-9623-b1bed482e13a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:52.916041 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c0b142-b7e7-4aea-9623-b1bed482e13a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:52.916490 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c0b142-b7e7-4aea-9623-b1bed482e13a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:52.916911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c5c0b142-b7e7-4aea-9623-b1bed482e13a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:53.071593 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c5c0b142-b7e7-4aea-9623-b1bed482e13a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:53.084560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c5c0b142-b7e7-4aea-9623-b1bed482e13a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.183554 Aug 08 13:50:53.085354 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 533/1058] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:52 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:54.107770 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-925a2400-76d1-4c5f-92af-c9258a4bf6ce tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:54.108353 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-925a2400-76d1-4c5f-92af-c9258a4bf6ce tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:54.110696 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:54.120919 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-925a2400-76d1-4c5f-92af-c9258a4bf6ce tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:54.121403 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-925a2400-76d1-4c5f-92af-c9258a4bf6ce tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:54.121834 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-925a2400-76d1-4c5f-92af-c9258a4bf6ce tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:54.122627 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-925a2400-76d1-4c5f-92af-c9258a4bf6ce tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:54.123063 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-925a2400-76d1-4c5f-92af-c9258a4bf6ce tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:54.127491 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-925a2400-76d1-4c5f-92af-c9258a4bf6ce tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:54.128105 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:54.279137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-925a2400-76d1-4c5f-92af-c9258a4bf6ce tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:54.290297 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-925a2400-76d1-4c5f-92af-c9258a4bf6ce tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.186651 Aug 08 13:50:54.297472 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 526/1059] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:54 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:55.312128 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-987aff03-dc50-4b9b-8850-f2d59f169379 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:55.312761 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-987aff03-dc50-4b9b-8850-f2d59f169379 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:55.315582 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:55.316235 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:55.321886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-987aff03-dc50-4b9b-8850-f2d59f169379 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:55.322362 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-987aff03-dc50-4b9b-8850-f2d59f169379 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:55.322830 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-987aff03-dc50-4b9b-8850-f2d59f169379 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:55.323571 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-987aff03-dc50-4b9b-8850-f2d59f169379 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:55.324026 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-987aff03-dc50-4b9b-8850-f2d59f169379 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:55.324441 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-987aff03-dc50-4b9b-8850-f2d59f169379 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:55.328183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=75 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:50:55.466182 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-987aff03-dc50-4b9b-8850-f2d59f169379 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:55.475910 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-987aff03-dc50-4b9b-8850-f2d59f169379 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.167752 Aug 08 13:50:55.476485 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 534/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:55 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:56.496900 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4e6a71ae-0062-4ffb-95d6-916566f1b7d0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:56.497551 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4e6a71ae-0062-4ffb-95d6-916566f1b7d0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:56.506903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e6a71ae-0062-4ffb-95d6-916566f1b7d0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:56.507470 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e6a71ae-0062-4ffb-95d6-916566f1b7d0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:56.507903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e6a71ae-0062-4ffb-95d6-916566f1b7d0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:56.508611 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e6a71ae-0062-4ffb-95d6-916566f1b7d0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:56.509097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e6a71ae-0062-4ffb-95d6-916566f1b7d0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:56.509487 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4e6a71ae-0062-4ffb-95d6-916566f1b7d0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:56.647717 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4e6a71ae-0062-4ffb-95d6-916566f1b7d0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:56.656039 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4e6a71ae-0062-4ffb-95d6-916566f1b7d0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.162986 Aug 08 13:50:56.656614 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 527/1061] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:56 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:57.680886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-f18e8765-7751-4909-9adf-64fc414d6138 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:57.681491 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-f18e8765-7751-4909-9adf-64fc414d6138 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:57.690535 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f18e8765-7751-4909-9adf-64fc414d6138 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:57.691019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f18e8765-7751-4909-9adf-64fc414d6138 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:57.691484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f18e8765-7751-4909-9adf-64fc414d6138 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:57.692175 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f18e8765-7751-4909-9adf-64fc414d6138 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:57.692623 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f18e8765-7751-4909-9adf-64fc414d6138 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:57.693041 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-f18e8765-7751-4909-9adf-64fc414d6138 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:57.836756 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-f18e8765-7751-4909-9adf-64fc414d6138 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:57.844641 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-f18e8765-7751-4909-9adf-64fc414d6138 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.169587 Aug 08 13:50:57.845207 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 535/1062] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:57 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:50:58.664353 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-4af4986f-b4fc-4eb7-8d39-82d5a22922e2 req-b7986c39-c639-4232-b331-506237d66e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d5cf9a-8fbc-48de-82b7-68f7efbb7c57", "name": "network-vif-plugged", "status": "completed", "tag": "5bef4e62-6ed6-4736-8d16-55194c4c9be2"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:50:58.675588 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-4af4986f-b4fc-4eb7-8d39-82d5a22922e2 req-b7986c39-c639-4232-b331-506237d66e1e service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:58.676088 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-4af4986f-b4fc-4eb7-8d39-82d5a22922e2 req-b7986c39-c639-4232-b331-506237d66e1e service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:58.676512 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-4af4986f-b4fc-4eb7-8d39-82d5a22922e2 req-b7986c39-c639-4232-b331-506237d66e1e service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:58.687740 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-4af4986f-b4fc-4eb7-8d39-82d5a22922e2 req-b7986c39-c639-4232-b331-506237d66e1e service nova] Creating event network-vif-plugged:5bef4e62-6ed6-4736-8d16-55194c4c9be2 for instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 on hv-cinder-85199 Aug 08 13:50:58.693020 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-4af4986f-b4fc-4eb7-8d39-82d5a22922e2 req-b7986c39-c639-4232-b331-506237d66e1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032419 Aug 08 13:50:58.693952 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 528/1063] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:50:58.866023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0b9ffeb5-bc3b-4bff-84fc-e1fff4f6ef48 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:50:58.866934 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0b9ffeb5-bc3b-4bff-84fc-e1fff4f6ef48 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:50:58.873491 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b9ffeb5-bc3b-4bff-84fc-e1fff4f6ef48 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:58.874183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b9ffeb5-bc3b-4bff-84fc-e1fff4f6ef48 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:58.874655 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b9ffeb5-bc3b-4bff-84fc-e1fff4f6ef48 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:58.875445 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b9ffeb5-bc3b-4bff-84fc-e1fff4f6ef48 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:50:58.875958 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b9ffeb5-bc3b-4bff-84fc-e1fff4f6ef48 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:50:58.876437 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0b9ffeb5-bc3b-4bff-84fc-e1fff4f6ef48 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:50:59.059551 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0b9ffeb5-bc3b-4bff-84fc-e1fff4f6ef48 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:50:59.067629 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0b9ffeb5-bc3b-4bff-84fc-e1fff4f6ef48 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.205556 Aug 08 13:50:59.068388 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 536/1064] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:50:58 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:51:00.090378 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-27094ea0-5a92-4601-a747-05f2842fad13 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:51:00.091061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-27094ea0-5a92-4601-a747-05f2842fad13 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:51:00.098283 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27094ea0-5a92-4601-a747-05f2842fad13 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:51:00.098750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27094ea0-5a92-4601-a747-05f2842fad13 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:51:00.099213 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27094ea0-5a92-4601-a747-05f2842fad13 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:51:00.099897 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27094ea0-5a92-4601-a747-05f2842fad13 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:51:00.100338 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27094ea0-5a92-4601-a747-05f2842fad13 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:51:00.100751 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-27094ea0-5a92-4601-a747-05f2842fad13 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:51:00.242320 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-27094ea0-5a92-4601-a747-05f2842fad13 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:51:00.250058 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-27094ea0-5a92-4601-a747-05f2842fad13 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1259 microversion: 2.1 time: 0.164408 Aug 08 13:51:00.250638 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 529/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:51:00 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:51:01.271945 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a08a1c7a-aa0c-4b93-980f-81d8fce16a9a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:51:01.272532 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a08a1c7a-aa0c-4b93-980f-81d8fce16a9a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:51:01.279527 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a08a1c7a-aa0c-4b93-980f-81d8fce16a9a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:51:01.280048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a08a1c7a-aa0c-4b93-980f-81d8fce16a9a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:51:01.280476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a08a1c7a-aa0c-4b93-980f-81d8fce16a9a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:51:01.281166 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a08a1c7a-aa0c-4b93-980f-81d8fce16a9a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:51:01.281596 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a08a1c7a-aa0c-4b93-980f-81d8fce16a9a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:51:01.282153 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a08a1c7a-aa0c-4b93-980f-81d8fce16a9a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:51:01.419439 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a08a1c7a-aa0c-4b93-980f-81d8fce16a9a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:51:01.428994 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a08a1c7a-aa0c-4b93-980f-81d8fce16a9a tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1443 microversion: 2.1 time: 0.161212 Aug 08 13:51:01.429566 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 537/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:51:01 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:51:01.449244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a0cbf0fd-82ea-4a44-a5f0-1dfb423e78f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:51:01.449857 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a0cbf0fd-82ea-4a44-a5f0-1dfb423e78f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:51:01.456405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0cbf0fd-82ea-4a44-a5f0-1dfb423e78f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:51:01.456890 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0cbf0fd-82ea-4a44-a5f0-1dfb423e78f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:51:01.457322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0cbf0fd-82ea-4a44-a5f0-1dfb423e78f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:51:01.458015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0cbf0fd-82ea-4a44-a5f0-1dfb423e78f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:51:01.458466 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0cbf0fd-82ea-4a44-a5f0-1dfb423e78f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:51:01.458885 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0cbf0fd-82ea-4a44-a5f0-1dfb423e78f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:51:01.599423 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a0cbf0fd-82ea-4a44-a5f0-1dfb423e78f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:51:01.607400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a0cbf0fd-82ea-4a44-a5f0-1dfb423e78f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1443 microversion: 2.1 time: 0.162148 Aug 08 13:51:01.607971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 530/1067] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:51:01 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:51:03.505019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-452d37b3-1f21-4067-b147-6cb0049bd9c0 req-3be4ce63-85af-43be-922c-c636ec629f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d5cf9a-8fbc-48de-82b7-68f7efbb7c57", "tag": "5bef4e62-6ed6-4736-8d16-55194c4c9be2"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:51:03.515529 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-452d37b3-1f21-4067-b147-6cb0049bd9c0 req-3be4ce63-85af-43be-922c-c636ec629f23 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:51:03.516073 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-452d37b3-1f21-4067-b147-6cb0049bd9c0 req-3be4ce63-85af-43be-922c-c636ec629f23 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:51:03.516544 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-452d37b3-1f21-4067-b147-6cb0049bd9c0 req-3be4ce63-85af-43be-922c-c636ec629f23 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:51:03.528729 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-452d37b3-1f21-4067-b147-6cb0049bd9c0 req-3be4ce63-85af-43be-922c-c636ec629f23 service nova] Creating event network-changed:5bef4e62-6ed6-4736-8d16-55194c4c9be2 for instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 on hv-cinder-85199 Aug 08 13:51:03.534717 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-452d37b3-1f21-4067-b147-6cb0049bd9c0 req-3be4ce63-85af-43be-922c-c636ec629f23 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033998 Aug 08 13:51:03.535677 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 538/1068] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:52:54.197617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 08 13:52:54.248603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 08 13:52:54.248603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Mon Aug 8 13:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 13:52:58.184528 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a65e6bb-c66e-4cd1-94c3-86eae21cb8e2] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 08 13:52:58.185215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=13 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:52:58.185848 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=37 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:52:58.189893 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0453902a-d034-4bf0-9176-c21427015398 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:52:58.190425 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0453902a-d034-4bf0-9176-c21427015398 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:52:58.197225 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0453902a-d034-4bf0-9176-c21427015398 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:52:58.197699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0453902a-d034-4bf0-9176-c21427015398 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:52:58.198124 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0453902a-d034-4bf0-9176-c21427015398 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:52:58.198808 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0453902a-d034-4bf0-9176-c21427015398 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:52:58.199283 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0453902a-d034-4bf0-9176-c21427015398 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:52:58.199698 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0453902a-d034-4bf0-9176-c21427015398 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:52:58.225588 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0453902a-d034-4bf0-9176-c21427015398 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:52:58.312830 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0453902a-d034-4bf0-9176-c21427015398 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 204 len: 0 microversion: 2.1 time: 0.130177 Aug 08 13:52:58.313532 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 531/1069] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:52:58 2022] DELETE /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:52:58.323022 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [554b678a-9974-4fef-a1b8-70f9423cf36a] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 08 13:52:58.323686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=9 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:52:58.324535 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=25 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:52:58.330042 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-282549c0-fb99-4d30-8289-371c8d663b22 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:52:58.330747 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-282549c0-fb99-4d30-8289-371c8d663b22 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:52:58.337726 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-282549c0-fb99-4d30-8289-371c8d663b22 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:52:58.338209 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-282549c0-fb99-4d30-8289-371c8d663b22 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:52:58.338680 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-282549c0-fb99-4d30-8289-371c8d663b22 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:52:58.339401 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-282549c0-fb99-4d30-8289-371c8d663b22 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:52:58.339856 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-282549c0-fb99-4d30-8289-371c8d663b22 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:52:58.340280 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-282549c0-fb99-4d30-8289-371c8d663b22 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:52:58.486986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-282549c0-fb99-4d30-8289-371c8d663b22 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:52:58.494945 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-282549c0-fb99-4d30-8289-371c8d663b22 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1575 microversion: 2.1 time: 0.176117 Aug 08 13:52:58.495538 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 539/1070] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:52:58 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:52:59.527792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c0bc3bd2-fdb0-4199-a943-f43ec13f24a9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:52:59.528614 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c0bc3bd2-fdb0-4199-a943-f43ec13f24a9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:52:59.536335 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c0bc3bd2-fdb0-4199-a943-f43ec13f24a9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:52:59.536821 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c0bc3bd2-fdb0-4199-a943-f43ec13f24a9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:52:59.537253 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c0bc3bd2-fdb0-4199-a943-f43ec13f24a9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:52:59.537952 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c0bc3bd2-fdb0-4199-a943-f43ec13f24a9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:52:59.538402 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c0bc3bd2-fdb0-4199-a943-f43ec13f24a9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:52:59.538820 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c0bc3bd2-fdb0-4199-a943-f43ec13f24a9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:52:59.555305 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a65e6bb-c66e-4cd1-94c3-86eae21cb8e2] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 48620. Aug 08 13:52:59.682397 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c0bc3bd2-fdb0-4199-a943-f43ec13f24a9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:52:59.690205 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c0bc3bd2-fdb0-4199-a943-f43ec13f24a9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1575 microversion: 2.1 time: 0.166790 Aug 08 13:52:59.690780 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 532/1071] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:52:59 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:00.712550 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ebcc6f8d-a453-4389-bf79-05d043a9e49c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:00.712550 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ebcc6f8d-a453-4389-bf79-05d043a9e49c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:00.720575 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ebcc6f8d-a453-4389-bf79-05d043a9e49c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:00.721059 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ebcc6f8d-a453-4389-bf79-05d043a9e49c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:00.721603 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ebcc6f8d-a453-4389-bf79-05d043a9e49c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:00.722254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ebcc6f8d-a453-4389-bf79-05d043a9e49c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:00.722593 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ebcc6f8d-a453-4389-bf79-05d043a9e49c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:00.722998 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ebcc6f8d-a453-4389-bf79-05d043a9e49c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:00.731875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [-] [554b678a-9974-4fef-a1b8-70f9423cf36a] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 48624. Aug 08 13:53:00.799020 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ebcc6f8d-a453-4389-bf79-05d043a9e49c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:00.806957 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ebcc6f8d-a453-4389-bf79-05d043a9e49c tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1508 microversion: 2.1 time: 0.099076 Aug 08 13:53:00.807563 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 540/1072] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:00 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1508 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:01.098331 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-e3666f70-52d9-43c1-bdc1-ca0a32126f7a req-a33a96a6-69ff-4b36-b83d-eac374a23c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0608a48e-ce46-4bfa-8ee2-e59a1e6415cc", "name": "network-vif-deleted", "tag": "7fb52cdd-3685-47bf-89ea-e901a4a9c57e"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:53:01.110810 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-e3666f70-52d9-43c1-bdc1-ca0a32126f7a req-a33a96a6-69ff-4b36-b83d-eac374a23c7f service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:01.111518 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-e3666f70-52d9-43c1-bdc1-ca0a32126f7a req-a33a96a6-69ff-4b36-b83d-eac374a23c7f service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:01.112123 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-e3666f70-52d9-43c1-bdc1-ca0a32126f7a req-a33a96a6-69ff-4b36-b83d-eac374a23c7f service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:01.128461 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-e3666f70-52d9-43c1-bdc1-ca0a32126f7a req-a33a96a6-69ff-4b36-b83d-eac374a23c7f service nova] Creating event network-vif-deleted:7fb52cdd-3685-47bf-89ea-e901a4a9c57e for instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc on hv-cinder-85199 Aug 08 13:53:01.135513 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-e3666f70-52d9-43c1-bdc1-ca0a32126f7a req-a33a96a6-69ff-4b36-b83d-eac374a23c7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112017 Aug 08 13:53:01.136106 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 533/1073] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 13:53:01.829089 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:01.829826 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:01.836875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:01.837391 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:01.838007 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:01.838915 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:01.839638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:01.840583 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:01.874392 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:01.874877 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:01.875368 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:01.876038 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lazy-loading 'fault' on Instance uuid 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:53:01.921307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:01.929339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-dcfebb66-622c-4b96-934c-ec9b686782e7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 200 len: 1230 microversion: 2.1 time: 0.104451 Aug 08 13:53:01.930023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 541/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:01 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:02.557851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 13:53:02.558082 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Mon Aug 8 13:53:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 13:53:02.952679 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:02.953796 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:02.960050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:02.960530 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:02.960955 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:02.961637 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:02.962078 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:02.962493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:02.976578 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] HTTP exception thrown: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Request method failure captured: Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc HTTP/1.1 Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8RSBldsahuh_IebB5myptj3S3gjnxXbqOVowi6_K08ZOYhcVHmln13j_BwrVO1d4NjUejFvb6JJLIjPVLOpS-hvfT0vE5-4i98fPpPSm1IajR0gvfQyoKoqR8lKPgQk0_aWV8IB9nn7pQ2LgjnfKDGskTgAJri2JWGUryvsXSwxWtz8 Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: a019b128831a47b7996b3d3e9d6e5652 Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:53:02.978238 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a019b128831a47b7996b3d3e9d6e5652"}]}] Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: a019b128831a47b7996b3d3e9d6e5652 Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-TestVolumeBootPattern-1874176799-project Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: d4bb35df2ffd48bf965425afcdbc42fd Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-TestVolumeBootPattern-1874176799-project Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:53:02.980050 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '0608a48e-ce46-4bfa-8ee2-e59a1e6415cc'} Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:53:02.981018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:53:02.982699 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:53:02.984217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Returning 404 to user: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:53:02.984217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-cdfa05c4-035c-4a55-88b2-da79cd9f0d0a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 404 len: 111 microversion: 2.1 time: 0.031880 Aug 08 13:53:02.984217 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 534/1075] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:02 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:53:03.031057 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-505913321", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1648947255", "security_groups": [{"name": "tempest-secgroup-smoke-981625919"}], "block_device_mapping_v2": [{"uuid": "7d937cda-2cfb-4b8b-b1b9-8f4124560a59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4009b150-c6f5-40ec-8551-113c0a775000"}]}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:53:03.150246 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] validate_networks() for [('4009b150-c6f5-40ec-8551-113c0a775000', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:53:03.537031 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:53:03.537576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:53:03.538234 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:53:03.538791 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:53:03.539492 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:53:03.553346 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:03.554019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:03.554632 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:03.555757 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:03.556395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:03.557019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:03.576215 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Getting quotas for project a019b128831a47b7996b3d3e9d6e5652. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:53:03.580670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Getting quotas for user d4bb35df2ffd48bf965425afcdbc42fd and project a019b128831a47b7996b3d3e9d6e5652. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:53:03.641580 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:53:03.643737 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d937cda-2cfb-4b8b-b1b9-8f4124560a59',volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:53:03.776891 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3342f883-fdc9-4ff6-8072-2cf766a0a0c6 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.749700 Aug 08 13:53:03.777539 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 542/1076] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:53:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:53:03.788587 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-15bf0981-8e5f-46c3-8e07-2b9ceee96fb7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:03.789002 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-15bf0981-8e5f-46c3-8e07-2b9ceee96fb7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:03.847277 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-15bf0981-8e5f-46c3-8e07-2b9ceee96fb7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:03.854040 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-15bf0981-8e5f-46c3-8e07-2b9ceee96fb7 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1094 microversion: 2.1 time: 0.069494 Aug 08 13:53:03.854617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 535/1077] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:03 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:04.874645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-d51f0b28-0614-4b7b-a773-dbda3b301592 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:04.875357 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-d51f0b28-0614-4b7b-a773-dbda3b301592 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:04.882007 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d51f0b28-0614-4b7b-a773-dbda3b301592 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:04.882492 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d51f0b28-0614-4b7b-a773-dbda3b301592 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:04.882923 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d51f0b28-0614-4b7b-a773-dbda3b301592 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:04.883654 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d51f0b28-0614-4b7b-a773-dbda3b301592 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:04.884108 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d51f0b28-0614-4b7b-a773-dbda3b301592 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:04.884529 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-d51f0b28-0614-4b7b-a773-dbda3b301592 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:04.946750 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-d51f0b28-0614-4b7b-a773-dbda3b301592 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:04.954393 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-d51f0b28-0614-4b7b-a773-dbda3b301592 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1192 microversion: 2.1 time: 0.084267 Aug 08 13:53:04.954958 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 543/1078] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:04 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:05.976195 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a995e9de-6173-4663-a707-587598d48676 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:05.976795 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a995e9de-6173-4663-a707-587598d48676 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:05.984556 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a995e9de-6173-4663-a707-587598d48676 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:05.985040 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a995e9de-6173-4663-a707-587598d48676 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:05.985475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a995e9de-6173-4663-a707-587598d48676 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:05.986209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a995e9de-6173-4663-a707-587598d48676 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:05.986622 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a995e9de-6173-4663-a707-587598d48676 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:05.987045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a995e9de-6173-4663-a707-587598d48676 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:06.456627 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a995e9de-6173-4663-a707-587598d48676 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:06.464763 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a995e9de-6173-4663-a707-587598d48676 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.492678 Aug 08 13:53:06.465334 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 536/1079] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:05 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:06.746289 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-7993a2a7-80cd-4cab-9406-879b585b8503 req-f4b9bbf2-ad24-422c-b56d-f7dcd2a417e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7def083-1d61-4a2f-8e5e-0917c10131f0", "tag": "2475f52a-b4ef-4864-894d-dcaec5267299"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:53:06.756914 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7993a2a7-80cd-4cab-9406-879b585b8503 req-f4b9bbf2-ad24-422c-b56d-f7dcd2a417e2 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:06.757396 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7993a2a7-80cd-4cab-9406-879b585b8503 req-f4b9bbf2-ad24-422c-b56d-f7dcd2a417e2 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:06.757841 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7993a2a7-80cd-4cab-9406-879b585b8503 req-f4b9bbf2-ad24-422c-b56d-f7dcd2a417e2 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:06.769844 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-7993a2a7-80cd-4cab-9406-879b585b8503 req-f4b9bbf2-ad24-422c-b56d-f7dcd2a417e2 service nova] Creating event network-changed:2475f52a-b4ef-4864-894d-dcaec5267299 for instance a7def083-1d61-4a2f-8e5e-0917c10131f0 on hv-cinder-85199 Aug 08 13:53:06.775070 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-7993a2a7-80cd-4cab-9406-879b585b8503 req-f4b9bbf2-ad24-422c-b56d-f7dcd2a417e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032478 Aug 08 13:53:06.775824 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 544/1080] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:53:07.487015 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-20d71fe8-0d72-4c4b-8b1f-5ac0e9f40c7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:07.487640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-20d71fe8-0d72-4c4b-8b1f-5ac0e9f40c7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:07.494400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20d71fe8-0d72-4c4b-8b1f-5ac0e9f40c7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:07.494883 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20d71fe8-0d72-4c4b-8b1f-5ac0e9f40c7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:07.495352 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20d71fe8-0d72-4c4b-8b1f-5ac0e9f40c7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:07.496048 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20d71fe8-0d72-4c4b-8b1f-5ac0e9f40c7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:07.496902 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20d71fe8-0d72-4c4b-8b1f-5ac0e9f40c7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:07.496902 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-20d71fe8-0d72-4c4b-8b1f-5ac0e9f40c7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:07.641632 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-20d71fe8-0d72-4c4b-8b1f-5ac0e9f40c7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:07.649285 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-20d71fe8-0d72-4c4b-8b1f-5ac0e9f40c7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.166722 Aug 08 13:53:07.649826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 537/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:07 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:08.670972 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-64b4607b-ed10-4d22-b647-da097d26bd9b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:08.671678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-64b4607b-ed10-4d22-b647-da097d26bd9b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:08.679496 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b4607b-ed10-4d22-b647-da097d26bd9b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:08.680183 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b4607b-ed10-4d22-b647-da097d26bd9b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:08.680742 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b4607b-ed10-4d22-b647-da097d26bd9b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:08.681784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b4607b-ed10-4d22-b647-da097d26bd9b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:08.682433 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b4607b-ed10-4d22-b647-da097d26bd9b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:08.683023 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-64b4607b-ed10-4d22-b647-da097d26bd9b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:08.820185 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-64b4607b-ed10-4d22-b647-da097d26bd9b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:08.829686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-64b4607b-ed10-4d22-b647-da097d26bd9b tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.163458 Aug 08 13:53:08.830242 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 545/1082] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:08 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:09.851026 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d9acf3cd-ba44-40c8-b5c0-bd47460e5a42 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:09.851658 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d9acf3cd-ba44-40c8-b5c0-bd47460e5a42 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:09.858617 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d9acf3cd-ba44-40c8-b5c0-bd47460e5a42 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:09.859103 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d9acf3cd-ba44-40c8-b5c0-bd47460e5a42 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:09.859580 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d9acf3cd-ba44-40c8-b5c0-bd47460e5a42 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:09.860230 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d9acf3cd-ba44-40c8-b5c0-bd47460e5a42 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:09.860966 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d9acf3cd-ba44-40c8-b5c0-bd47460e5a42 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:09.861385 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d9acf3cd-ba44-40c8-b5c0-bd47460e5a42 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:10.014768 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d9acf3cd-ba44-40c8-b5c0-bd47460e5a42 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:10.022860 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d9acf3cd-ba44-40c8-b5c0-bd47460e5a42 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.175773 Aug 08 13:53:10.023492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 538/1083] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:09 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:11.046820 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-c41039be-070c-4c63-8344-4c554824ff40 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:11.047481 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-c41039be-070c-4c63-8344-4c554824ff40 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:11.055967 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c41039be-070c-4c63-8344-4c554824ff40 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:11.056450 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c41039be-070c-4c63-8344-4c554824ff40 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:11.056896 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c41039be-070c-4c63-8344-4c554824ff40 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:11.057590 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c41039be-070c-4c63-8344-4c554824ff40 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:11.058040 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c41039be-070c-4c63-8344-4c554824ff40 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:11.058460 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-c41039be-070c-4c63-8344-4c554824ff40 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:11.201864 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-c41039be-070c-4c63-8344-4c554824ff40 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:11.210218 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-c41039be-070c-4c63-8344-4c554824ff40 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.169302 Aug 08 13:53:11.210782 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 546/1084] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:11 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:12.231905 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-8e71d242-c0c4-405a-88c7-b15e1b51748e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:12.232531 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-8e71d242-c0c4-405a-88c7-b15e1b51748e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:12.239687 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e71d242-c0c4-405a-88c7-b15e1b51748e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:12.240171 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e71d242-c0c4-405a-88c7-b15e1b51748e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:12.240607 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e71d242-c0c4-405a-88c7-b15e1b51748e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:12.241308 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e71d242-c0c4-405a-88c7-b15e1b51748e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:12.241756 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e71d242-c0c4-405a-88c7-b15e1b51748e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:12.242267 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-8e71d242-c0c4-405a-88c7-b15e1b51748e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:12.393624 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-8e71d242-c0c4-405a-88c7-b15e1b51748e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:12.401381 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-8e71d242-c0c4-405a-88c7-b15e1b51748e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.173506 Aug 08 13:53:12.401965 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 539/1085] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:12 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:13.422474 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ff0ba606-17ba-47d6-b16b-f30e55740eec tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:13.423044 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ff0ba606-17ba-47d6-b16b-f30e55740eec tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:13.429784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff0ba606-17ba-47d6-b16b-f30e55740eec tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:13.430258 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff0ba606-17ba-47d6-b16b-f30e55740eec tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:13.430685 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff0ba606-17ba-47d6-b16b-f30e55740eec tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:13.431409 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff0ba606-17ba-47d6-b16b-f30e55740eec tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:13.431851 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff0ba606-17ba-47d6-b16b-f30e55740eec tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:13.432262 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ff0ba606-17ba-47d6-b16b-f30e55740eec tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:13.566773 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:53:13.579499 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ff0ba606-17ba-47d6-b16b-f30e55740eec tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:13.587647 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ff0ba606-17ba-47d6-b16b-f30e55740eec tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.169227 Aug 08 13:53:13.588254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 547/1086] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:13 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:14.609826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-c4024697-7d70-4d5b-be89-76b499f8219a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:14.610476 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-c4024697-7d70-4d5b-be89-76b499f8219a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:14.612890 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:53:14.618499 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4024697-7d70-4d5b-be89-76b499f8219a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:14.618966 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4024697-7d70-4d5b-be89-76b499f8219a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:14.619442 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4024697-7d70-4d5b-be89-76b499f8219a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:14.620167 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4024697-7d70-4d5b-be89-76b499f8219a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:14.620645 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4024697-7d70-4d5b-be89-76b499f8219a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:14.621083 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-c4024697-7d70-4d5b-be89-76b499f8219a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:14.759640 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-c4024697-7d70-4d5b-be89-76b499f8219a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:14.767433 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-c4024697-7d70-4d5b-be89-76b499f8219a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.161585 Aug 08 13:53:14.768009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 540/1087] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:14 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:15.785127 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:53:15.791214 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-4be2a217-5bcc-47a1-87c4-2770c7408608 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:15.792139 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-4be2a217-5bcc-47a1-87c4-2770c7408608 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:15.800542 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4be2a217-5bcc-47a1-87c4-2770c7408608 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:15.801019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4be2a217-5bcc-47a1-87c4-2770c7408608 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:15.801445 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4be2a217-5bcc-47a1-87c4-2770c7408608 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:15.802132 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4be2a217-5bcc-47a1-87c4-2770c7408608 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:15.802563 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4be2a217-5bcc-47a1-87c4-2770c7408608 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:15.803009 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-4be2a217-5bcc-47a1-87c4-2770c7408608 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:15.951550 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-4be2a217-5bcc-47a1-87c4-2770c7408608 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:15.959958 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-4be2a217-5bcc-47a1-87c4-2770c7408608 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.175642 Aug 08 13:53:15.960522 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 548/1088] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:15 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:16.985496 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d3906957-5318-482d-84b0-03ece9983ccf tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:16.986435 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d3906957-5318-482d-84b0-03ece9983ccf tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:16.997109 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3906957-5318-482d-84b0-03ece9983ccf tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:16.997893 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3906957-5318-482d-84b0-03ece9983ccf tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:16.998605 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3906957-5318-482d-84b0-03ece9983ccf tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:16.999787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3906957-5318-482d-84b0-03ece9983ccf tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:17.000537 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3906957-5318-482d-84b0-03ece9983ccf tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:17.001348 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d3906957-5318-482d-84b0-03ece9983ccf tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:17.142483 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d3906957-5318-482d-84b0-03ece9983ccf tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:17.154010 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d3906957-5318-482d-84b0-03ece9983ccf tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.174907 Aug 08 13:53:17.162627 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 541/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:16 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:17.272675 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ad77e4f9-5ded-4a59-8e0b-28c131f5ce3c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:53:17.273165 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ad77e4f9-5ded-4a59-8e0b-28c131f5ce3c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:17.279189 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad77e4f9-5ded-4a59-8e0b-28c131f5ce3c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:17.279670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad77e4f9-5ded-4a59-8e0b-28c131f5ce3c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:17.280095 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad77e4f9-5ded-4a59-8e0b-28c131f5ce3c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:17.280778 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad77e4f9-5ded-4a59-8e0b-28c131f5ce3c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:17.281219 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad77e4f9-5ded-4a59-8e0b-28c131f5ce3c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:17.281634 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ad77e4f9-5ded-4a59-8e0b-28c131f5ce3c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:17.304842 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.objects.instance [None req-ad77e4f9-5ded-4a59-8e0b-28c131f5ce3c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lazy-loading 'flavor' on Instance uuid 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 {{(pid=124408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:53:17.383475 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ad77e4f9-5ded-4a59-8e0b-28c131f5ce3c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "POST /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57/action" status: 202 len: 0 microversion: 2.1 time: 0.115008 Aug 08 13:53:17.384160 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 549/1090] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:53:17 2022] POST /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:53:17.392853 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-37db3e81-a4fd-42da-82bd-fd20cf5b3ffc tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:17.393455 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-37db3e81-a4fd-42da-82bd-fd20cf5b3ffc tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:17.399503 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-37db3e81-a4fd-42da-82bd-fd20cf5b3ffc tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:17.399986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-37db3e81-a4fd-42da-82bd-fd20cf5b3ffc tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:17.400437 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-37db3e81-a4fd-42da-82bd-fd20cf5b3ffc tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:17.401356 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-37db3e81-a4fd-42da-82bd-fd20cf5b3ffc tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:17.401815 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-37db3e81-a4fd-42da-82bd-fd20cf5b3ffc tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:17.402287 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-37db3e81-a4fd-42da-82bd-fd20cf5b3ffc tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:17.542523 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-37db3e81-a4fd-42da-82bd-fd20cf5b3ffc tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:17.553865 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-37db3e81-a4fd-42da-82bd-fd20cf5b3ffc tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.165039 Aug 08 13:53:17.554626 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 542/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:17 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:18.184787 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-82ec565e-ab07-4ce2-a680-738f05b928e9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:18.185509 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-82ec565e-ab07-4ce2-a680-738f05b928e9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:18.192539 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-82ec565e-ab07-4ce2-a680-738f05b928e9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:18.193037 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-82ec565e-ab07-4ce2-a680-738f05b928e9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:18.193486 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-82ec565e-ab07-4ce2-a680-738f05b928e9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:18.194216 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-82ec565e-ab07-4ce2-a680-738f05b928e9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:18.194706 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-82ec565e-ab07-4ce2-a680-738f05b928e9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:18.195185 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-82ec565e-ab07-4ce2-a680-738f05b928e9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:18.331467 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-82ec565e-ab07-4ce2-a680-738f05b928e9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:18.339310 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-82ec565e-ab07-4ce2-a680-738f05b928e9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.158975 Aug 08 13:53:18.339880 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 550/1092] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:18 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:18.578878 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5a9000fa-dab2-41ca-a04c-3abd3994e9e4 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:18.579595 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5a9000fa-dab2-41ca-a04c-3abd3994e9e4 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:18.586376 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a9000fa-dab2-41ca-a04c-3abd3994e9e4 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:18.586855 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a9000fa-dab2-41ca-a04c-3abd3994e9e4 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:18.587294 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a9000fa-dab2-41ca-a04c-3abd3994e9e4 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:18.587985 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a9000fa-dab2-41ca-a04c-3abd3994e9e4 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:18.588430 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a9000fa-dab2-41ca-a04c-3abd3994e9e4 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:18.588845 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5a9000fa-dab2-41ca-a04c-3abd3994e9e4 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:18.739214 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5a9000fa-dab2-41ca-a04c-3abd3994e9e4 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:18.747113 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5a9000fa-dab2-41ca-a04c-3abd3994e9e4 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.172303 Aug 08 13:53:18.747686 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 543/1093] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:18 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:19.301426 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-f4a0c9a9-b9c1-4c9b-9b48-09c4482f36dc req-0f7e6a8d-5392-488d-9b9f-eaff6ff994f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7def083-1d61-4a2f-8e5e-0917c10131f0", "name": "network-vif-plugged", "status": "completed", "tag": "2475f52a-b4ef-4864-894d-dcaec5267299"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:53:19.310802 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-f4a0c9a9-b9c1-4c9b-9b48-09c4482f36dc req-0f7e6a8d-5392-488d-9b9f-eaff6ff994f8 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:19.311327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-f4a0c9a9-b9c1-4c9b-9b48-09c4482f36dc req-0f7e6a8d-5392-488d-9b9f-eaff6ff994f8 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:19.311784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-f4a0c9a9-b9c1-4c9b-9b48-09c4482f36dc req-0f7e6a8d-5392-488d-9b9f-eaff6ff994f8 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:19.323102 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-f4a0c9a9-b9c1-4c9b-9b48-09c4482f36dc req-0f7e6a8d-5392-488d-9b9f-eaff6ff994f8 service nova] Creating event network-vif-plugged:2475f52a-b4ef-4864-894d-dcaec5267299 for instance a7def083-1d61-4a2f-8e5e-0917c10131f0 on hv-cinder-85199 Aug 08 13:53:19.327960 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-f4a0c9a9-b9c1-4c9b-9b48-09c4482f36dc req-0f7e6a8d-5392-488d-9b9f-eaff6ff994f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092977 Aug 08 13:53:19.328566 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 551/1094] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:53:19.359746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ebaaa3d4-c8f0-441e-8a32-3150f43a49a5 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:19.360352 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ebaaa3d4-c8f0-441e-8a32-3150f43a49a5 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:19.366865 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ebaaa3d4-c8f0-441e-8a32-3150f43a49a5 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:19.367379 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ebaaa3d4-c8f0-441e-8a32-3150f43a49a5 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:19.367810 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ebaaa3d4-c8f0-441e-8a32-3150f43a49a5 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:19.368512 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ebaaa3d4-c8f0-441e-8a32-3150f43a49a5 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:19.368946 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ebaaa3d4-c8f0-441e-8a32-3150f43a49a5 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:19.369370 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ebaaa3d4-c8f0-441e-8a32-3150f43a49a5 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:19.502749 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ebaaa3d4-c8f0-441e-8a32-3150f43a49a5 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:19.511200 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ebaaa3d4-c8f0-441e-8a32-3150f43a49a5 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.155015 Aug 08 13:53:19.512044 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 544/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:19 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:19.774659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-df0ab0f6-1e3e-4c12-9871-54b3939b7a88 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:19.775388 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-df0ab0f6-1e3e-4c12-9871-54b3939b7a88 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:19.782105 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df0ab0f6-1e3e-4c12-9871-54b3939b7a88 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:19.782686 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df0ab0f6-1e3e-4c12-9871-54b3939b7a88 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:19.783062 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df0ab0f6-1e3e-4c12-9871-54b3939b7a88 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:19.783797 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df0ab0f6-1e3e-4c12-9871-54b3939b7a88 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:19.784250 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df0ab0f6-1e3e-4c12-9871-54b3939b7a88 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:19.784670 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-df0ab0f6-1e3e-4c12-9871-54b3939b7a88 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:19.936080 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-df0ab0f6-1e3e-4c12-9871-54b3939b7a88 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:19.944662 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-df0ab0f6-1e3e-4c12-9871-54b3939b7a88 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.174289 Aug 08 13:53:19.945231 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 552/1096] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:19 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:20.534098 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a0fb69b6-81b3-43d1-aa8f-a84dfe30924f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:20.534719 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a0fb69b6-81b3-43d1-aa8f-a84dfe30924f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:20.541675 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0fb69b6-81b3-43d1-aa8f-a84dfe30924f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:20.542153 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0fb69b6-81b3-43d1-aa8f-a84dfe30924f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:20.542582 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0fb69b6-81b3-43d1-aa8f-a84dfe30924f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:20.543303 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0fb69b6-81b3-43d1-aa8f-a84dfe30924f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:20.543751 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0fb69b6-81b3-43d1-aa8f-a84dfe30924f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:20.544168 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a0fb69b6-81b3-43d1-aa8f-a84dfe30924f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:20.677407 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a0fb69b6-81b3-43d1-aa8f-a84dfe30924f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:20.684883 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a0fb69b6-81b3-43d1-aa8f-a84dfe30924f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1265 microversion: 2.1 time: 0.155093 Aug 08 13:53:20.685485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 545/1097] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:20 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:20.970731 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fb6c0711-b1fd-4c59-a24e-aa8281b96649 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:20.971638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fb6c0711-b1fd-4c59-a24e-aa8281b96649 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:20.983140 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb6c0711-b1fd-4c59-a24e-aa8281b96649 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:20.983996 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb6c0711-b1fd-4c59-a24e-aa8281b96649 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:20.984733 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb6c0711-b1fd-4c59-a24e-aa8281b96649 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:20.985876 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb6c0711-b1fd-4c59-a24e-aa8281b96649 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:20.986327 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb6c0711-b1fd-4c59-a24e-aa8281b96649 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:20.986751 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fb6c0711-b1fd-4c59-a24e-aa8281b96649 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:21.138450 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fb6c0711-b1fd-4c59-a24e-aa8281b96649 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:21.146305 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fb6c0711-b1fd-4c59-a24e-aa8281b96649 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.182899 Aug 08 13:53:21.146883 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 553/1098] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:20 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:21.706905 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-70fafb30-e8b5-49ab-b386-30504a49a593 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:21.707523 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-70fafb30-e8b5-49ab-b386-30504a49a593 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:21.714526 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70fafb30-e8b5-49ab-b386-30504a49a593 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:21.715008 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70fafb30-e8b5-49ab-b386-30504a49a593 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:21.715445 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70fafb30-e8b5-49ab-b386-30504a49a593 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:21.716163 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70fafb30-e8b5-49ab-b386-30504a49a593 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:21.716615 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70fafb30-e8b5-49ab-b386-30504a49a593 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:21.717027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-70fafb30-e8b5-49ab-b386-30504a49a593 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:21.850658 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-70fafb30-e8b5-49ab-b386-30504a49a593 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:21.858599 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-70fafb30-e8b5-49ab-b386-30504a49a593 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1452 microversion: 2.1 time: 0.156132 Aug 08 13:53:21.859190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 546/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:21 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:21.882042 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-81128b5b-9e70-47d9-a3a1-2724fac4dd39 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:21.883061 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-81128b5b-9e70-47d9-a3a1-2724fac4dd39 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:21.892729 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81128b5b-9e70-47d9-a3a1-2724fac4dd39 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:21.893210 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81128b5b-9e70-47d9-a3a1-2724fac4dd39 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:21.893637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81128b5b-9e70-47d9-a3a1-2724fac4dd39 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:21.894322 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81128b5b-9e70-47d9-a3a1-2724fac4dd39 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:21.894770 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81128b5b-9e70-47d9-a3a1-2724fac4dd39 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:21.895223 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-81128b5b-9e70-47d9-a3a1-2724fac4dd39 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:22.034810 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-81128b5b-9e70-47d9-a3a1-2724fac4dd39 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:22.042515 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-81128b5b-9e70-47d9-a3a1-2724fac4dd39 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1452 microversion: 2.1 time: 0.167444 Aug 08 13:53:22.043145 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 554/1100] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:21 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:22.168019 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-cb7af37f-a5c9-4b09-9315-5fe4c3fe0493 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:22.168627 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-cb7af37f-a5c9-4b09-9315-5fe4c3fe0493 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:22.174869 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb7af37f-a5c9-4b09-9315-5fe4c3fe0493 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:22.175404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb7af37f-a5c9-4b09-9315-5fe4c3fe0493 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:22.175839 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb7af37f-a5c9-4b09-9315-5fe4c3fe0493 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:22.176539 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb7af37f-a5c9-4b09-9315-5fe4c3fe0493 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:22.176993 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb7af37f-a5c9-4b09-9315-5fe4c3fe0493 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:22.177519 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cb7af37f-a5c9-4b09-9315-5fe4c3fe0493 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:22.314787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-cb7af37f-a5c9-4b09-9315-5fe4c3fe0493 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:22.322938 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-cb7af37f-a5c9-4b09-9315-5fe4c3fe0493 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.158788 Aug 08 13:53:22.324036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 547/1101] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:22 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:23.345284 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-147fa74f-bf24-4532-aa9a-359bf7355b93 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:23.346019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-147fa74f-bf24-4532-aa9a-359bf7355b93 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:23.352974 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-147fa74f-bf24-4532-aa9a-359bf7355b93 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:23.353462 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-147fa74f-bf24-4532-aa9a-359bf7355b93 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:23.353910 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-147fa74f-bf24-4532-aa9a-359bf7355b93 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:23.354637 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-147fa74f-bf24-4532-aa9a-359bf7355b93 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:23.355108 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-147fa74f-bf24-4532-aa9a-359bf7355b93 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:23.355541 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-147fa74f-bf24-4532-aa9a-359bf7355b93 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:23.359918 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:53:23.498674 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-147fa74f-bf24-4532-aa9a-359bf7355b93 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:23.506434 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-147fa74f-bf24-4532-aa9a-359bf7355b93 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.165962 Aug 08 13:53:23.507072 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 555/1102] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:23 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:53:23.954494 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-f09a789d-3769-4c1e-b1f5-847982448085 req-afd95064-082b-4170-81a8-efe0542c8dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7def083-1d61-4a2f-8e5e-0917c10131f0", "tag": "2475f52a-b4ef-4864-894d-dcaec5267299"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:53:23.964605 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-f09a789d-3769-4c1e-b1f5-847982448085 req-afd95064-082b-4170-81a8-efe0542c8dd7 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:23.965216 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-f09a789d-3769-4c1e-b1f5-847982448085 req-afd95064-082b-4170-81a8-efe0542c8dd7 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:23.965713 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-f09a789d-3769-4c1e-b1f5-847982448085 req-afd95064-082b-4170-81a8-efe0542c8dd7 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:23.969867 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:53:23.978804 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-f09a789d-3769-4c1e-b1f5-847982448085 req-afd95064-082b-4170-81a8-efe0542c8dd7 service nova] Creating event network-changed:2475f52a-b4ef-4864-894d-dcaec5267299 for instance a7def083-1d61-4a2f-8e5e-0917c10131f0 on hv-cinder-85199 Aug 08 13:53:23.984311 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-f09a789d-3769-4c1e-b1f5-847982448085 req-afd95064-082b-4170-81a8-efe0542c8dd7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033714 Aug 08 13:53:23.984917 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 548/1103] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:53:24.527693 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ddda9c68-2c45-45cb-9e22-001c158afc0c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:24.528936 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ddda9c68-2c45-45cb-9e22-001c158afc0c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:24.535678 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ddda9c68-2c45-45cb-9e22-001c158afc0c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:24.536177 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ddda9c68-2c45-45cb-9e22-001c158afc0c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:24.536606 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ddda9c68-2c45-45cb-9e22-001c158afc0c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:24.537288 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ddda9c68-2c45-45cb-9e22-001c158afc0c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:24.537916 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ddda9c68-2c45-45cb-9e22-001c158afc0c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:24.538529 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ddda9c68-2c45-45cb-9e22-001c158afc0c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:24.689889 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ddda9c68-2c45-45cb-9e22-001c158afc0c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:24.697699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ddda9c68-2c45-45cb-9e22-001c158afc0c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.173972 Aug 08 13:53:24.698365 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 556/1104] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:24 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:25.720963 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-52d58f01-16f5-4d99-be77-c2c5abffa026 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:25.721649 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-52d58f01-16f5-4d99-be77-c2c5abffa026 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:25.728602 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-52d58f01-16f5-4d99-be77-c2c5abffa026 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:25.729082 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-52d58f01-16f5-4d99-be77-c2c5abffa026 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:25.729511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-52d58f01-16f5-4d99-be77-c2c5abffa026 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:25.730200 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-52d58f01-16f5-4d99-be77-c2c5abffa026 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:25.730648 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-52d58f01-16f5-4d99-be77-c2c5abffa026 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:25.731069 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-52d58f01-16f5-4d99-be77-c2c5abffa026 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:25.870357 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-52d58f01-16f5-4d99-be77-c2c5abffa026 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:25.880127 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-52d58f01-16f5-4d99-be77-c2c5abffa026 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.164451 Aug 08 13:53:25.880706 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 549/1105] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:25 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:26.904583 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-20cf5219-1c81-4711-961b-17cf0ddedc49 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:26.905390 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-20cf5219-1c81-4711-961b-17cf0ddedc49 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:26.914752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-20cf5219-1c81-4711-961b-17cf0ddedc49 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:26.915483 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-20cf5219-1c81-4711-961b-17cf0ddedc49 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:26.916088 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-20cf5219-1c81-4711-961b-17cf0ddedc49 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:26.917083 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-20cf5219-1c81-4711-961b-17cf0ddedc49 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:26.917727 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-20cf5219-1c81-4711-961b-17cf0ddedc49 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:26.918335 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-20cf5219-1c81-4711-961b-17cf0ddedc49 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:27.059476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-20cf5219-1c81-4711-961b-17cf0ddedc49 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:27.070614 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-20cf5219-1c81-4711-961b-17cf0ddedc49 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.171560 Aug 08 13:53:27.071432 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 557/1106] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:26 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:28.092524 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-966f10ae-a4da-4d67-a89e-46e99ab5e0a6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:28.093130 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-966f10ae-a4da-4d67-a89e-46e99ab5e0a6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:28.100647 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-966f10ae-a4da-4d67-a89e-46e99ab5e0a6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:28.101207 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-966f10ae-a4da-4d67-a89e-46e99ab5e0a6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:28.101712 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-966f10ae-a4da-4d67-a89e-46e99ab5e0a6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:28.102472 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-966f10ae-a4da-4d67-a89e-46e99ab5e0a6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:28.102924 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-966f10ae-a4da-4d67-a89e-46e99ab5e0a6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:28.103375 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-966f10ae-a4da-4d67-a89e-46e99ab5e0a6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:28.332070 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-966f10ae-a4da-4d67-a89e-46e99ab5e0a6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:28.343881 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-966f10ae-a4da-4d67-a89e-46e99ab5e0a6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.254685 Aug 08 13:53:28.344846 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 550/1107] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:28 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:29.369883 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9c8b59f6-8418-4910-ac29-3176ce9b7cb6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:29.369883 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9c8b59f6-8418-4910-ac29-3176ce9b7cb6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:29.372432 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:53:29.379063 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c8b59f6-8418-4910-ac29-3176ce9b7cb6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:29.379775 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c8b59f6-8418-4910-ac29-3176ce9b7cb6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:29.380366 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c8b59f6-8418-4910-ac29-3176ce9b7cb6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:29.381155 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c8b59f6-8418-4910-ac29-3176ce9b7cb6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:29.381777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c8b59f6-8418-4910-ac29-3176ce9b7cb6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:29.382363 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9c8b59f6-8418-4910-ac29-3176ce9b7cb6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:29.520846 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9c8b59f6-8418-4910-ac29-3176ce9b7cb6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:29.528886 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9c8b59f6-8418-4910-ac29-3176ce9b7cb6 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.165674 Aug 08 13:53:29.529495 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 558/1108] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:29 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:30.550359 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a1f206a9-d354-4d3a-a8f4-7ef5510a69bb tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:30.551106 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a1f206a9-d354-4d3a-a8f4-7ef5510a69bb tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:30.553460 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:53:30.559246 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1f206a9-d354-4d3a-a8f4-7ef5510a69bb tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:30.560014 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1f206a9-d354-4d3a-a8f4-7ef5510a69bb tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:30.560467 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1f206a9-d354-4d3a-a8f4-7ef5510a69bb tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:30.561215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1f206a9-d354-4d3a-a8f4-7ef5510a69bb tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:30.561696 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1f206a9-d354-4d3a-a8f4-7ef5510a69bb tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:30.562114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a1f206a9-d354-4d3a-a8f4-7ef5510a69bb tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:30.700737 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a1f206a9-d354-4d3a-a8f4-7ef5510a69bb tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:30.708431 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a1f206a9-d354-4d3a-a8f4-7ef5510a69bb tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.162242 Aug 08 13:53:30.708997 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 551/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:30 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:31.732277 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-a81f4207-3c5b-49d3-a868-cb6fbe7863ae tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:31.733071 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-a81f4207-3c5b-49d3-a868-cb6fbe7863ae tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:31.740031 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a81f4207-3c5b-49d3-a868-cb6fbe7863ae tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:31.740512 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a81f4207-3c5b-49d3-a868-cb6fbe7863ae tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:31.740939 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a81f4207-3c5b-49d3-a868-cb6fbe7863ae tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:31.741622 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a81f4207-3c5b-49d3-a868-cb6fbe7863ae tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:31.742064 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a81f4207-3c5b-49d3-a868-cb6fbe7863ae tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:31.742483 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-a81f4207-3c5b-49d3-a868-cb6fbe7863ae tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:31.884097 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-a81f4207-3c5b-49d3-a868-cb6fbe7863ae tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:31.896287 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-a81f4207-3c5b-49d3-a868-cb6fbe7863ae tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1509 microversion: 2.1 time: 0.169249 Aug 08 13:53:31.897143 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 559/1110] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:31 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:31.920654 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-cf356fdd-8d00-4d32-8d72-b83886a9a799 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:53:31.921239 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-cf356fdd-8d00-4d32-8d72-b83886a9a799 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:31.928158 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf356fdd-8d00-4d32-8d72-b83886a9a799 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:31.928633 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf356fdd-8d00-4d32-8d72-b83886a9a799 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:31.929061 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf356fdd-8d00-4d32-8d72-b83886a9a799 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:31.929743 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf356fdd-8d00-4d32-8d72-b83886a9a799 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:31.930186 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf356fdd-8d00-4d32-8d72-b83886a9a799 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:31.930636 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-cf356fdd-8d00-4d32-8d72-b83886a9a799 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:31.972903 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-cf356fdd-8d00-4d32-8d72-b83886a9a799 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124407) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 13:53:32.052190 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-cf356fdd-8d00-4d32-8d72-b83886a9a799 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "POST /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57/action" status: 202 len: 0 microversion: 2.1 time: 0.135278 Aug 08 13:53:32.055806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 552/1111] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 13:53:31 2022] POST /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:53:32.063814 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3fac619d-9b6b-41ad-924d-6813fa823967 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:32.064444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3fac619d-9b6b-41ad-924d-6813fa823967 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:32.070349 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3fac619d-9b6b-41ad-924d-6813fa823967 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:32.070819 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3fac619d-9b6b-41ad-924d-6813fa823967 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:32.071476 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3fac619d-9b6b-41ad-924d-6813fa823967 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:32.072384 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3fac619d-9b6b-41ad-924d-6813fa823967 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:32.072836 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3fac619d-9b6b-41ad-924d-6813fa823967 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:32.073261 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3fac619d-9b6b-41ad-924d-6813fa823967 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:32.218120 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3fac619d-9b6b-41ad-924d-6813fa823967 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:32.226343 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3fac619d-9b6b-41ad-924d-6813fa823967 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1517 microversion: 2.1 time: 0.167835 Aug 08 13:53:32.226882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 560/1112] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:32 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:33.248648 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-7839e6ea-0b75-4023-b75c-bb4797bc5f28 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:33.249298 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-7839e6ea-0b75-4023-b75c-bb4797bc5f28 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:33.256949 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7839e6ea-0b75-4023-b75c-bb4797bc5f28 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:33.257388 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7839e6ea-0b75-4023-b75c-bb4797bc5f28 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:33.257826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7839e6ea-0b75-4023-b75c-bb4797bc5f28 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:33.258651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7839e6ea-0b75-4023-b75c-bb4797bc5f28 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:33.259139 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7839e6ea-0b75-4023-b75c-bb4797bc5f28 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:33.259575 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-7839e6ea-0b75-4023-b75c-bb4797bc5f28 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:33.398505 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-7839e6ea-0b75-4023-b75c-bb4797bc5f28 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:33.406503 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-7839e6ea-0b75-4023-b75c-bb4797bc5f28 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1519 microversion: 2.1 time: 0.162800 Aug 08 13:53:33.407220 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 553/1113] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:33 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:34.428397 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-30a122b3-24aa-4e8c-b01f-3a9005089621 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:34.429097 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-30a122b3-24aa-4e8c-b01f-3a9005089621 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:34.435605 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-30a122b3-24aa-4e8c-b01f-3a9005089621 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:34.436079 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-30a122b3-24aa-4e8c-b01f-3a9005089621 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:34.436513 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-30a122b3-24aa-4e8c-b01f-3a9005089621 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:34.437199 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-30a122b3-24aa-4e8c-b01f-3a9005089621 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:34.437640 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-30a122b3-24aa-4e8c-b01f-3a9005089621 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:34.438054 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-30a122b3-24aa-4e8c-b01f-3a9005089621 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:34.648940 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-30a122b3-24aa-4e8c-b01f-3a9005089621 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:34.656649 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-30a122b3-24aa-4e8c-b01f-3a9005089621 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1575 microversion: 2.1 time: 0.232137 Aug 08 13:53:34.657217 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 561/1114] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:34 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:35.256803 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-f8185abc-6777-4103-afb0-7deb6c7311ef req-4ec0ff4a-877a-4ba1-97b1-17ea31fa3993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d5cf9a-8fbc-48de-82b7-68f7efbb7c57", "name": "network-vif-unplugged", "status": "completed", "tag": "5bef4e62-6ed6-4736-8d16-55194c4c9be2"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:53:35.269335 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-f8185abc-6777-4103-afb0-7deb6c7311ef req-4ec0ff4a-877a-4ba1-97b1-17ea31fa3993 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:35.269693 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-f8185abc-6777-4103-afb0-7deb6c7311ef req-4ec0ff4a-877a-4ba1-97b1-17ea31fa3993 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:35.270208 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-f8185abc-6777-4103-afb0-7deb6c7311ef req-4ec0ff4a-877a-4ba1-97b1-17ea31fa3993 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:35.282652 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-f8185abc-6777-4103-afb0-7deb6c7311ef req-4ec0ff4a-877a-4ba1-97b1-17ea31fa3993 service nova] Creating event network-vif-unplugged:5bef4e62-6ed6-4736-8d16-55194c4c9be2 for instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 on hv-cinder-85199 Aug 08 13:53:35.287828 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-f8185abc-6777-4103-afb0-7deb6c7311ef req-4ec0ff4a-877a-4ba1-97b1-17ea31fa3993 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035280 Aug 08 13:53:35.288593 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 554/1115] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:53:35.678100 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-3a15beaa-ca27-4547-a6ca-2eef9fa3a80b tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:35.678723 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-3a15beaa-ca27-4547-a6ca-2eef9fa3a80b tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:35.685474 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3a15beaa-ca27-4547-a6ca-2eef9fa3a80b tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:35.685964 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3a15beaa-ca27-4547-a6ca-2eef9fa3a80b tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:35.686393 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3a15beaa-ca27-4547-a6ca-2eef9fa3a80b tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:35.687118 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3a15beaa-ca27-4547-a6ca-2eef9fa3a80b tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:35.687577 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3a15beaa-ca27-4547-a6ca-2eef9fa3a80b tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:35.688000 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-3a15beaa-ca27-4547-a6ca-2eef9fa3a80b tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:35.921699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-3a15beaa-ca27-4547-a6ca-2eef9fa3a80b tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:35.929862 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-3a15beaa-ca27-4547-a6ca-2eef9fa3a80b tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1575 microversion: 2.1 time: 0.255625 Aug 08 13:53:35.930496 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 562/1116] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:35 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:36.955834 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-26cb74f0-7369-40f0-8e8d-f3282c554281 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:36.956542 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-26cb74f0-7369-40f0-8e8d-f3282c554281 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:36.963603 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26cb74f0-7369-40f0-8e8d-f3282c554281 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:36.964076 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26cb74f0-7369-40f0-8e8d-f3282c554281 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:36.964505 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26cb74f0-7369-40f0-8e8d-f3282c554281 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:36.965241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26cb74f0-7369-40f0-8e8d-f3282c554281 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:36.965658 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26cb74f0-7369-40f0-8e8d-f3282c554281 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:36.966065 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-26cb74f0-7369-40f0-8e8d-f3282c554281 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:37.115102 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-26cb74f0-7369-40f0-8e8d-f3282c554281 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:37.123782 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-26cb74f0-7369-40f0-8e8d-f3282c554281 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1575 microversion: 2.1 time: 0.174266 Aug 08 13:53:37.124386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 555/1117] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:36 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:38.145567 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-31a8cbac-663a-4efe-bf42-5764f457c2f2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:38.146226 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-31a8cbac-663a-4efe-bf42-5764f457c2f2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:38.153173 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-31a8cbac-663a-4efe-bf42-5764f457c2f2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:38.153653 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-31a8cbac-663a-4efe-bf42-5764f457c2f2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:38.154056 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-31a8cbac-663a-4efe-bf42-5764f457c2f2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:38.154777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-31a8cbac-663a-4efe-bf42-5764f457c2f2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:38.155254 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-31a8cbac-663a-4efe-bf42-5764f457c2f2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:38.155674 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-31a8cbac-663a-4efe-bf42-5764f457c2f2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:38.292786 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-31a8cbac-663a-4efe-bf42-5764f457c2f2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:38.300740 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-31a8cbac-663a-4efe-bf42-5764f457c2f2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1575 microversion: 2.1 time: 0.159263 Aug 08 13:53:38.301314 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 563/1118] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:38 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:39.324722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4bebe7f7-ed04-47c7-8e42-ca379d35695c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:39.325545 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4bebe7f7-ed04-47c7-8e42-ca379d35695c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:39.335141 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4bebe7f7-ed04-47c7-8e42-ca379d35695c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:39.335854 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4bebe7f7-ed04-47c7-8e42-ca379d35695c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:39.336506 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4bebe7f7-ed04-47c7-8e42-ca379d35695c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:39.337492 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4bebe7f7-ed04-47c7-8e42-ca379d35695c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:39.338126 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4bebe7f7-ed04-47c7-8e42-ca379d35695c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:39.338734 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4bebe7f7-ed04-47c7-8e42-ca379d35695c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:39.751676 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4bebe7f7-ed04-47c7-8e42-ca379d35695c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:39.762791 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4bebe7f7-ed04-47c7-8e42-ca379d35695c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1575 microversion: 2.1 time: 0.443545 Aug 08 13:53:39.763633 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 556/1119] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:39 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1575 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:40.791420 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8290a1b1-bf38-4722-b604-c053f79536c9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:40.792056 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8290a1b1-bf38-4722-b604-c053f79536c9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:40.799010 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8290a1b1-bf38-4722-b604-c053f79536c9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:40.799533 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8290a1b1-bf38-4722-b604-c053f79536c9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:40.799968 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8290a1b1-bf38-4722-b604-c053f79536c9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:40.800665 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8290a1b1-bf38-4722-b604-c053f79536c9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:40.801118 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8290a1b1-bf38-4722-b604-c053f79536c9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:40.801543 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8290a1b1-bf38-4722-b604-c053f79536c9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:40.948986 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8290a1b1-bf38-4722-b604-c053f79536c9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:40.957339 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8290a1b1-bf38-4722-b604-c053f79536c9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1575 microversion: 2.1 time: 0.169851 Aug 08 13:53:40.957911 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 564/1120] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:40 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:41.978125 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-ad049dea-a5b9-414c-a117-24ee1dc3edb2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:41.978777 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-ad049dea-a5b9-414c-a117-24ee1dc3edb2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:41.985769 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad049dea-a5b9-414c-a117-24ee1dc3edb2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:41.986248 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad049dea-a5b9-414c-a117-24ee1dc3edb2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:41.986689 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad049dea-a5b9-414c-a117-24ee1dc3edb2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:41.987425 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad049dea-a5b9-414c-a117-24ee1dc3edb2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:41.988001 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad049dea-a5b9-414c-a117-24ee1dc3edb2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:41.988417 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-ad049dea-a5b9-414c-a117-24ee1dc3edb2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:42.140735 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-ad049dea-a5b9-414c-a117-24ee1dc3edb2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:42.148550 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-ad049dea-a5b9-414c-a117-24ee1dc3edb2 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1575 microversion: 2.1 time: 0.174433 Aug 08 13:53:42.149126 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 557/1121] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:41 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:43.170451 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-38041b08-e749-41e0-a221-1c4063bd4492 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:43.171128 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-38041b08-e749-41e0-a221-1c4063bd4492 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:43.178477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38041b08-e749-41e0-a221-1c4063bd4492 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:43.178963 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38041b08-e749-41e0-a221-1c4063bd4492 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:43.179482 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38041b08-e749-41e0-a221-1c4063bd4492 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:43.180347 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38041b08-e749-41e0-a221-1c4063bd4492 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:43.180679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38041b08-e749-41e0-a221-1c4063bd4492 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:43.181118 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-38041b08-e749-41e0-a221-1c4063bd4492 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:43.324223 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-38041b08-e749-41e0-a221-1c4063bd4492 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:43.332198 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-38041b08-e749-41e0-a221-1c4063bd4492 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1575 microversion: 2.1 time: 0.165886 Aug 08 13:53:43.332737 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 565/1122] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:43 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:44.355435 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-3d00f0ca-7158-48e1-bc57-72ae56ce3583 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:53:44.356092 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-3d00f0ca-7158-48e1-bc57-72ae56ce3583 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:53:44.362206 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d00f0ca-7158-48e1-bc57-72ae56ce3583 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:44.362660 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d00f0ca-7158-48e1-bc57-72ae56ce3583 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:44.363096 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d00f0ca-7158-48e1-bc57-72ae56ce3583 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:44.363778 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d00f0ca-7158-48e1-bc57-72ae56ce3583 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:44.364216 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d00f0ca-7158-48e1-bc57-72ae56ce3583 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:44.364632 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-3d00f0ca-7158-48e1-bc57-72ae56ce3583 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:44.508214 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-3d00f0ca-7158-48e1-bc57-72ae56ce3583 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:53:44.516021 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-3d00f0ca-7158-48e1-bc57-72ae56ce3583 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1562 microversion: 2.1 time: 0.165587 Aug 08 13:53:44.516606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 558/1123] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:53:44 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:53:47.389808 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-573b0e65-6288-4cd5-b708-ecc1f1781639 req-e141926c-42c8-4fa3-a50b-d3ba925e6056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d5cf9a-8fbc-48de-82b7-68f7efbb7c57", "name": "network-vif-plugged", "status": "completed", "tag": "5bef4e62-6ed6-4736-8d16-55194c4c9be2"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:53:47.403127 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-573b0e65-6288-4cd5-b708-ecc1f1781639 req-e141926c-42c8-4fa3-a50b-d3ba925e6056 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:53:47.403624 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-573b0e65-6288-4cd5-b708-ecc1f1781639 req-e141926c-42c8-4fa3-a50b-d3ba925e6056 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:53:47.404051 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-573b0e65-6288-4cd5-b708-ecc1f1781639 req-e141926c-42c8-4fa3-a50b-d3ba925e6056 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:53:47.415508 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-573b0e65-6288-4cd5-b708-ecc1f1781639 req-e141926c-42c8-4fa3-a50b-d3ba925e6056 service nova] Creating event network-vif-plugged:5bef4e62-6ed6-4736-8d16-55194c4c9be2 for instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 on hv-cinder-85199 Aug 08 13:53:47.420534 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-573b0e65-6288-4cd5-b708-ecc1f1781639 req-e141926c-42c8-4fa3-a50b-d3ba925e6056 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036805 Aug 08 13:53:47.421189 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 566/1124] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:55:14.775304 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:55:14.779438 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=17 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:55:14.780395 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:55:14.780783 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=66 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:55:14.785219 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-874a7e40-7629-41ea-a8c5-5c1e99f57fbe req-cf4ba5ad-a995-42c7-8ea1-f69463c9306c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d5cf9a-8fbc-48de-82b7-68f7efbb7c57", "tag": "5bef4e62-6ed6-4736-8d16-55194c4c9be2"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:55:14.795332 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-25eb650a-6cdb-457c-85b7-86c4f2a924df tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:14.795943 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-25eb650a-6cdb-457c-85b7-86c4f2a924df tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:14.804013 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25eb650a-6cdb-457c-85b7-86c4f2a924df tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:14.804493 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25eb650a-6cdb-457c-85b7-86c4f2a924df tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:14.804919 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25eb650a-6cdb-457c-85b7-86c4f2a924df tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:14.805623 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25eb650a-6cdb-457c-85b7-86c4f2a924df tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:14.806069 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25eb650a-6cdb-457c-85b7-86c4f2a924df tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:14.806487 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-25eb650a-6cdb-457c-85b7-86c4f2a924df tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:14.812060 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-874a7e40-7629-41ea-a8c5-5c1e99f57fbe req-cf4ba5ad-a995-42c7-8ea1-f69463c9306c service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:14.812546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-874a7e40-7629-41ea-a8c5-5c1e99f57fbe req-cf4ba5ad-a995-42c7-8ea1-f69463c9306c service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:14.812956 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-874a7e40-7629-41ea-a8c5-5c1e99f57fbe req-cf4ba5ad-a995-42c7-8ea1-f69463c9306c service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:14.826484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-874a7e40-7629-41ea-a8c5-5c1e99f57fbe req-cf4ba5ad-a995-42c7-8ea1-f69463c9306c service nova] Creating event network-changed:5bef4e62-6ed6-4736-8d16-55194c4c9be2 for instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 on hv-cinder-85199 Aug 08 13:55:14.832653 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-874a7e40-7629-41ea-a8c5-5c1e99f57fbe req-cf4ba5ad-a995-42c7-8ea1-f69463c9306c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055095 Aug 08 13:55:14.833692 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 567/1125] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:55:14.844209 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-25eb650a-6cdb-457c-85b7-86c4f2a924df tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:55:14.926042 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-25eb650a-6cdb-457c-85b7-86c4f2a924df tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "DELETE /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 204 len: 0 microversion: 2.1 time: 0.152754 Aug 08 13:55:14.926691 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 559/1126] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:55:14 2022] DELETE /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 13:55:14.935667 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0eb8c1fa-db4f-49cd-ba43-ca59cb358dca tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:14.936364 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0eb8c1fa-db4f-49cd-ba43-ca59cb358dca tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:14.942873 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0eb8c1fa-db4f-49cd-ba43-ca59cb358dca tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:14.943402 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0eb8c1fa-db4f-49cd-ba43-ca59cb358dca tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:14.943825 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0eb8c1fa-db4f-49cd-ba43-ca59cb358dca tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:14.944526 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0eb8c1fa-db4f-49cd-ba43-ca59cb358dca tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:14.944973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0eb8c1fa-db4f-49cd-ba43-ca59cb358dca tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:14.945395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0eb8c1fa-db4f-49cd-ba43-ca59cb358dca tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:15.083252 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0eb8c1fa-db4f-49cd-ba43-ca59cb358dca tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:15.090982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0eb8c1fa-db4f-49cd-ba43-ca59cb358dca tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.159538 Aug 08 13:55:15.105093 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 568/1127] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:14 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:16.117917 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6290fed3-1b79-414b-bab0-4d14002de10d tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:16.118684 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6290fed3-1b79-414b-bab0-4d14002de10d tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:16.126620 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6290fed3-1b79-414b-bab0-4d14002de10d tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:16.127106 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6290fed3-1b79-414b-bab0-4d14002de10d tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:16.127564 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6290fed3-1b79-414b-bab0-4d14002de10d tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:16.128268 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6290fed3-1b79-414b-bab0-4d14002de10d tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:16.128716 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6290fed3-1b79-414b-bab0-4d14002de10d tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:16.129147 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6290fed3-1b79-414b-bab0-4d14002de10d tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:16.261815 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6290fed3-1b79-414b-bab0-4d14002de10d tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:16.269745 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6290fed3-1b79-414b-bab0-4d14002de10d tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.159491 Aug 08 13:55:16.270322 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 560/1128] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:16 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:17.291119 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-7e7180e1-d186-47b8-9738-a0c77b61c9c3 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:17.291712 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-7e7180e1-d186-47b8-9738-a0c77b61c9c3 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:17.298760 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7e7180e1-d186-47b8-9738-a0c77b61c9c3 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:17.299265 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7e7180e1-d186-47b8-9738-a0c77b61c9c3 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:17.299690 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7e7180e1-d186-47b8-9738-a0c77b61c9c3 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:17.300370 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7e7180e1-d186-47b8-9738-a0c77b61c9c3 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:17.300812 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7e7180e1-d186-47b8-9738-a0c77b61c9c3 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:17.301226 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-7e7180e1-d186-47b8-9738-a0c77b61c9c3 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:17.446370 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-7e7180e1-d186-47b8-9738-a0c77b61c9c3 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:17.456713 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-7e7180e1-d186-47b8-9738-a0c77b61c9c3 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.169459 Aug 08 13:55:17.457319 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 569/1129] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:17 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:18.485006 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-6eca850b-2a52-4336-96d4-ce41a30f71f9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:18.486040 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-6eca850b-2a52-4336-96d4-ce41a30f71f9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:18.500034 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6eca850b-2a52-4336-96d4-ce41a30f71f9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:18.500740 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6eca850b-2a52-4336-96d4-ce41a30f71f9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:18.501378 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6eca850b-2a52-4336-96d4-ce41a30f71f9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:18.502195 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6eca850b-2a52-4336-96d4-ce41a30f71f9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:18.502757 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6eca850b-2a52-4336-96d4-ce41a30f71f9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:18.503552 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-6eca850b-2a52-4336-96d4-ce41a30f71f9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:18.709263 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-6eca850b-2a52-4336-96d4-ce41a30f71f9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:18.717036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-6eca850b-2a52-4336-96d4-ce41a30f71f9 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1568 microversion: 2.1 time: 0.238117 Aug 08 13:55:18.718709 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 561/1130] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:18 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:19.449184 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-e33c36aa-2ca8-4ca1-b2f8-e01f0cadd5f5 req-31881f28-b9ff-461c-9581-f263a64b9080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d5cf9a-8fbc-48de-82b7-68f7efbb7c57", "name": "network-vif-deleted", "tag": "5bef4e62-6ed6-4736-8d16-55194c4c9be2"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:55:19.460284 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-e33c36aa-2ca8-4ca1-b2f8-e01f0cadd5f5 req-31881f28-b9ff-461c-9581-f263a64b9080 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:19.460752 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-e33c36aa-2ca8-4ca1-b2f8-e01f0cadd5f5 req-31881f28-b9ff-461c-9581-f263a64b9080 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:19.461171 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-e33c36aa-2ca8-4ca1-b2f8-e01f0cadd5f5 req-31881f28-b9ff-461c-9581-f263a64b9080 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:19.474076 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-e33c36aa-2ca8-4ca1-b2f8-e01f0cadd5f5 req-31881f28-b9ff-461c-9581-f263a64b9080 service nova] Creating event network-vif-deleted:5bef4e62-6ed6-4736-8d16-55194c4c9be2 for instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 on hv-cinder-85199 Aug 08 13:55:19.480807 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-e33c36aa-2ca8-4ca1-b2f8-e01f0cadd5f5 req-31881f28-b9ff-461c-9581-f263a64b9080 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035239 Aug 08 13:55:19.481710 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 570/1131] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:55:19.739746 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-2b4d1252-8a91-4aaf-844f-8f219c3e5bad tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:19.740395 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-2b4d1252-8a91-4aaf-844f-8f219c3e5bad tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:19.749185 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2b4d1252-8a91-4aaf-844f-8f219c3e5bad tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:19.749785 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2b4d1252-8a91-4aaf-844f-8f219c3e5bad tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:19.750219 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2b4d1252-8a91-4aaf-844f-8f219c3e5bad tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:19.750971 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2b4d1252-8a91-4aaf-844f-8f219c3e5bad tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:19.751507 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2b4d1252-8a91-4aaf-844f-8f219c3e5bad tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:19.751933 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-2b4d1252-8a91-4aaf-844f-8f219c3e5bad tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:19.821581 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-2b4d1252-8a91-4aaf-844f-8f219c3e5bad tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:19.831111 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-2b4d1252-8a91-4aaf-844f-8f219c3e5bad tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1219 microversion: 2.1 time: 0.095148 Aug 08 13:55:19.831926 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 562/1132] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:19 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:20.853515 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-0e95d9ff-ee78-45c5-a763-78e6cc4fca59 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:20.854369 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-0e95d9ff-ee78-45c5-a763-78e6cc4fca59 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:20.861657 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e95d9ff-ee78-45c5-a763-78e6cc4fca59 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:20.862166 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e95d9ff-ee78-45c5-a763-78e6cc4fca59 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:20.862599 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e95d9ff-ee78-45c5-a763-78e6cc4fca59 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:20.863329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e95d9ff-ee78-45c5-a763-78e6cc4fca59 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:20.863774 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e95d9ff-ee78-45c5-a763-78e6cc4fca59 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:20.864193 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-0e95d9ff-ee78-45c5-a763-78e6cc4fca59 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:20.932671 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-0e95d9ff-ee78-45c5-a763-78e6cc4fca59 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:20.940383 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-0e95d9ff-ee78-45c5-a763-78e6cc4fca59 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1219 microversion: 2.1 time: 0.091552 Aug 08 13:55:20.940939 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 571/1133] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:20 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:21.961372 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5e2f157a-b11a-4a59-8507-e8e86506dcb0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:21.962000 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5e2f157a-b11a-4a59-8507-e8e86506dcb0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:21.969027 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e2f157a-b11a-4a59-8507-e8e86506dcb0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:21.969508 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e2f157a-b11a-4a59-8507-e8e86506dcb0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:21.969933 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e2f157a-b11a-4a59-8507-e8e86506dcb0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:21.970622 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e2f157a-b11a-4a59-8507-e8e86506dcb0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:21.971066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e2f157a-b11a-4a59-8507-e8e86506dcb0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:21.971503 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5e2f157a-b11a-4a59-8507-e8e86506dcb0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:22.041524 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5e2f157a-b11a-4a59-8507-e8e86506dcb0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:22.049354 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5e2f157a-b11a-4a59-8507-e8e86506dcb0 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1219 microversion: 2.1 time: 0.091868 Aug 08 13:55:22.049889 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 563/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:21 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:23.070659 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ed157494-2eef-441c-9ba2-deb99512bf9c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:23.071398 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ed157494-2eef-441c-9ba2-deb99512bf9c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:23.078042 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed157494-2eef-441c-9ba2-deb99512bf9c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:23.078560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed157494-2eef-441c-9ba2-deb99512bf9c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:23.079016 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed157494-2eef-441c-9ba2-deb99512bf9c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:23.079758 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed157494-2eef-441c-9ba2-deb99512bf9c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:23.080178 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed157494-2eef-441c-9ba2-deb99512bf9c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:23.080645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ed157494-2eef-441c-9ba2-deb99512bf9c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:23.145213 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ed157494-2eef-441c-9ba2-deb99512bf9c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:23.153395 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ed157494-2eef-441c-9ba2-deb99512bf9c tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1219 microversion: 2.1 time: 0.086743 Aug 08 13:55:23.153955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 572/1135] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:23 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:24.176195 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-942c17c0-4ee9-40e6-a4a1-2f825374a1a7 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:24.176853 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-942c17c0-4ee9-40e6-a4a1-2f825374a1a7 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:24.185826 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942c17c0-4ee9-40e6-a4a1-2f825374a1a7 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:24.186461 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942c17c0-4ee9-40e6-a4a1-2f825374a1a7 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:24.186986 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942c17c0-4ee9-40e6-a4a1-2f825374a1a7 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:24.187711 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942c17c0-4ee9-40e6-a4a1-2f825374a1a7 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:24.188162 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942c17c0-4ee9-40e6-a4a1-2f825374a1a7 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:24.188722 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-942c17c0-4ee9-40e6-a4a1-2f825374a1a7 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:24.254105 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-942c17c0-4ee9-40e6-a4a1-2f825374a1a7 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a63ce39dd942f9abb785d05cbd8c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c67730fcf64392b047dd178ee72db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:24.262657 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-942c17c0-4ee9-40e6-a4a1-2f825374a1a7 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 200 len: 1219 microversion: 2.1 time: 0.092210 Aug 08 13:55:24.263512 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 564/1136] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:24 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:25.216118 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-764211434", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1648947255", "security_groups": [{"name": "tempest-secgroup-smoke-981625919"}], "block_device_mapping_v2": [{"uuid": "40f7f2b0-4c4d-4dd5-a774-65f55734ffc4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4009b150-c6f5-40ec-8551-113c0a775000"}]}} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:55:25.284606 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:25.285183 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] [instance: 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:25.292104 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:25.292613 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:25.293184 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:25.293969 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:25.294421 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:25.294846 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:25.309535 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] HTTP exception thrown: Instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 could not be found. Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Request method failure captured: Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 HTTP/1.1 Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8RSVIV-Q2JiQOFZFwEnfmccyd6q6XQWvYbhJ2Bg5lsQDWkt-YjMUeG6Gy8GVk0x8uL5FIitbNma4c_jgXxwKGEd-Pzo5bwOudGcyxDpG44y6-dvNVTSVXSyQ5_Kl8dJ3Oro_8Ugn4jvp0VIOMdoDTxgcIiCgc00Lj6KMMbXVIunMGWI Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: e6c67730fcf64392b047dd178ee72db8 Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-TestShelveInstance-841545331 Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:55:25.311179 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6c67730fcf64392b047dd178ee72db8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e6c67730fcf64392b047dd178ee72db8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6c67730fcf64392b047dd178ee72db8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e6c67730fcf64392b047dd178ee72db8"}]}] Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-TestShelveInstance-841545331 Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: e6c67730fcf64392b047dd178ee72db8 Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-TestShelveInstance-841545331 Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-TestShelveInstance-841545331-project Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: 74a63ce39dd942f9abb785d05cbd8c2b Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-TestShelveInstance-841545331-project Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 could not be found. Aug 08 13:55:25.312806 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '42d5cf9a-8fbc-48de-82b7-68f7efbb7c57'} Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 could not be found. Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:55:25.313708 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 could not be found. Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 could not be found. Aug 08 13:55:25.315404 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:55:25.316716 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Returning 404 to user: Instance 42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:55:25.316716 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-51318256-a0ec-4a92-833b-262f7a74a2f8 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57" status: 404 len: 111 microversion: 2.1 time: 0.031895 Aug 08 13:55:25.316716 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 565/1137] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:25 2022] GET /compute/v2.1/servers/42d5cf9a-8fbc-48de-82b7-68f7efbb7c57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 13:55:25.444021 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.network.neutron [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] validate_networks() for [('4009b150-c6f5-40ec-8551-113c0a775000', None, None, None, None, None)] {{(pid=124408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 13:55:25.599952 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0987e688-411b-42ec-a0e4-e3cf9a264382 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] Calling method '.version_select at 0x7f7d24132ee0>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:25.637764 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0987e688-411b-42ec-a0e4-e3cf9a264382 tempest-TestShelveInstance-841545331 tempest-TestShelveInstance-841545331-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2135988892" status: 202 len: 0 microversion: 2.1 time: 0.041571 Aug 08 13:55:25.638602 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 566/1138] 10.222.0.33 () {58 vars in 1254 bytes} [Mon Aug 8 13:55:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2135988892 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 13:55:25.913456 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Flavor limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 13:55:25.913848 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Image limits 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 13:55:25.914320 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Flavor pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 13:55:25.914724 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Image pref 0:0:0 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 13:55:25.915232 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.virt.hardware [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 13:55:25.924390 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:25.924865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:25.925304 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:25.926041 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:25.926486 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:25.926913 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:25.944423 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Getting quotas for project a019b128831a47b7996b3d3e9d6e5652. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 13:55:25.948720 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.quota [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Getting quotas for user d4bb35df2ffd48bf965425afcdbc42fd and project a019b128831a47b7996b3d3e9d6e5652. Resources: {'instances', 'ram', 'cores'} {{(pid=124408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 13:55:26.015554 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Going to run 1 instances... {{(pid=124408) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 13:55:26.018336 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40f7f2b0-4c4d-4dd5-a774-65f55734ffc4',volume_size=None,volume_type=None)] {{(pid=124408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 13:55:26.153430 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-1637a639-d85b-4851-8f95-e232aa55c5d9 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.941151 Aug 08 13:55:26.154307 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 573/1139] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 13:55:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 13:55:26.165349 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-91e18587-d3a5-48a8-b546-bbd91114a6ba tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:26.166207 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-91e18587-d3a5-48a8-b546-bbd91114a6ba tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:26.288778 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-91e18587-d3a5-48a8-b546-bbd91114a6ba tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:26.298940 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-91e18587-d3a5-48a8-b546-bbd91114a6ba tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1094 microversion: 2.1 time: 0.137593 Aug 08 13:55:26.299745 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 567/1140] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:26 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1094 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:27.320894 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-976572c7-0049-40f4-a373-d6250bf1ef70 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:27.322261 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-976572c7-0049-40f4-a373-d6250bf1ef70 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:27.328881 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-976572c7-0049-40f4-a373-d6250bf1ef70 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:27.329656 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-976572c7-0049-40f4-a373-d6250bf1ef70 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:27.330257 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-976572c7-0049-40f4-a373-d6250bf1ef70 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:27.331252 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-976572c7-0049-40f4-a373-d6250bf1ef70 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:27.332070 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-976572c7-0049-40f4-a373-d6250bf1ef70 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:27.332698 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-976572c7-0049-40f4-a373-d6250bf1ef70 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:27.441419 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-976572c7-0049-40f4-a373-d6250bf1ef70 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:27.453443 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-976572c7-0049-40f4-a373-d6250bf1ef70 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1210 microversion: 2.1 time: 0.136775 Aug 08 13:55:27.455324 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 574/1141] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:27 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1210 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:28.475750 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a92e29af-627e-4c69-8413-1e3c46fdc347 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:28.476556 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a92e29af-627e-4c69-8413-1e3c46fdc347 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:28.483203 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a92e29af-627e-4c69-8413-1e3c46fdc347 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:28.483688 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a92e29af-627e-4c69-8413-1e3c46fdc347 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:28.484114 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a92e29af-627e-4c69-8413-1e3c46fdc347 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:28.484840 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a92e29af-627e-4c69-8413-1e3c46fdc347 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:28.485367 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a92e29af-627e-4c69-8413-1e3c46fdc347 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:28.485784 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a92e29af-627e-4c69-8413-1e3c46fdc347 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:28.758065 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a92e29af-627e-4c69-8413-1e3c46fdc347 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:28.765937 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a92e29af-627e-4c69-8413-1e3c46fdc347 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1265 microversion: 2.1 time: 0.294095 Aug 08 13:55:28.767215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 568/1142] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:28 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:29.120255 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-7bbdfa40-6b63-4264-898e-20d7a4daa0d4 req-8f52aca2-005c-4eba-8d5d-9728f045566a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f783cd-858b-4a44-8d99-1f3376aa9991", "tag": "7e3cbe2c-db7e-4f08-89c4-aa71609b9691"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:55:29.132527 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7bbdfa40-6b63-4264-898e-20d7a4daa0d4 req-8f52aca2-005c-4eba-8d5d-9728f045566a service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:29.133309 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7bbdfa40-6b63-4264-898e-20d7a4daa0d4 req-8f52aca2-005c-4eba-8d5d-9728f045566a service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:29.134085 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-7bbdfa40-6b63-4264-898e-20d7a4daa0d4 req-8f52aca2-005c-4eba-8d5d-9728f045566a service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:29.146415 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-7bbdfa40-6b63-4264-898e-20d7a4daa0d4 req-8f52aca2-005c-4eba-8d5d-9728f045566a service nova] Creating event network-changed:7e3cbe2c-db7e-4f08-89c4-aa71609b9691 for instance e1f783cd-858b-4a44-8d99-1f3376aa9991 on hv-cinder-85199 Aug 08 13:55:29.155148 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-7bbdfa40-6b63-4264-898e-20d7a4daa0d4 req-8f52aca2-005c-4eba-8d5d-9728f045566a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039939 Aug 08 13:55:29.156078 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 575/1143] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:55:29.788585 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4466b5e3-8c50-46c7-853b-89c14baef507 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:29.789449 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4466b5e3-8c50-46c7-853b-89c14baef507 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:29.796137 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4466b5e3-8c50-46c7-853b-89c14baef507 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:29.796729 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4466b5e3-8c50-46c7-853b-89c14baef507 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:29.797244 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4466b5e3-8c50-46c7-853b-89c14baef507 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:29.798347 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4466b5e3-8c50-46c7-853b-89c14baef507 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:29.798886 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4466b5e3-8c50-46c7-853b-89c14baef507 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:29.799402 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4466b5e3-8c50-46c7-853b-89c14baef507 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:29.974528 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4466b5e3-8c50-46c7-853b-89c14baef507 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:29.983141 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4466b5e3-8c50-46c7-853b-89c14baef507 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1265 microversion: 2.1 time: 0.198761 Aug 08 13:55:29.984108 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 569/1144] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:29 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:31.008234 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8d8e2c82-5e13-48bd-9d3b-f8ce743d5538 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:31.008944 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8d8e2c82-5e13-48bd-9d3b-f8ce743d5538 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:31.016890 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8d8e2c82-5e13-48bd-9d3b-f8ce743d5538 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:31.020775 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8d8e2c82-5e13-48bd-9d3b-f8ce743d5538 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:31.022166 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8d8e2c82-5e13-48bd-9d3b-f8ce743d5538 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:31.023272 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8d8e2c82-5e13-48bd-9d3b-f8ce743d5538 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:31.023987 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8d8e2c82-5e13-48bd-9d3b-f8ce743d5538 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:31.024415 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8d8e2c82-5e13-48bd-9d3b-f8ce743d5538 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:31.379458 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8d8e2c82-5e13-48bd-9d3b-f8ce743d5538 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:31.390507 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8d8e2c82-5e13-48bd-9d3b-f8ce743d5538 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1265 microversion: 2.1 time: 0.389010 Aug 08 13:55:31.391293 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 576/1145] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:30 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:32.422684 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4c365d74-6491-44b4-856c-a511d3bdd90e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:32.422684 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4c365d74-6491-44b4-856c-a511d3bdd90e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:32.431810 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4c365d74-6491-44b4-856c-a511d3bdd90e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:32.432407 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4c365d74-6491-44b4-856c-a511d3bdd90e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:32.437169 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4c365d74-6491-44b4-856c-a511d3bdd90e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:32.438126 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4c365d74-6491-44b4-856c-a511d3bdd90e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:32.438710 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4c365d74-6491-44b4-856c-a511d3bdd90e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:32.439549 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4c365d74-6491-44b4-856c-a511d3bdd90e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:32.785041 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4c365d74-6491-44b4-856c-a511d3bdd90e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:32.813710 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4c365d74-6491-44b4-856c-a511d3bdd90e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1265 microversion: 2.1 time: 0.403904 Aug 08 13:55:32.814455 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 570/1146] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:32 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1265 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:33.836501 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-8038e33c-b6e9-4081-be69-b22bf0c36a12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:33.837871 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-8038e33c-b6e9-4081-be69-b22bf0c36a12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:33.846005 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8038e33c-b6e9-4081-be69-b22bf0c36a12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:33.846733 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8038e33c-b6e9-4081-be69-b22bf0c36a12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:33.847468 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8038e33c-b6e9-4081-be69-b22bf0c36a12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:33.848404 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8038e33c-b6e9-4081-be69-b22bf0c36a12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:33.849096 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8038e33c-b6e9-4081-be69-b22bf0c36a12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:33.849612 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-8038e33c-b6e9-4081-be69-b22bf0c36a12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:33.997230 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-8038e33c-b6e9-4081-be69-b22bf0c36a12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:34.006847 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-8038e33c-b6e9-4081-be69-b22bf0c36a12 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1265 microversion: 2.1 time: 0.174418 Aug 08 13:55:34.007469 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 577/1147] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:33 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:35.031788 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-5b2b6df0-944c-4ee5-9f98-477f918c5553 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:35.032546 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-5b2b6df0-944c-4ee5-9f98-477f918c5553 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:35.043447 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b2b6df0-944c-4ee5-9f98-477f918c5553 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:35.044157 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b2b6df0-944c-4ee5-9f98-477f918c5553 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:35.044776 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b2b6df0-944c-4ee5-9f98-477f918c5553 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:35.045787 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b2b6df0-944c-4ee5-9f98-477f918c5553 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:35.046478 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b2b6df0-944c-4ee5-9f98-477f918c5553 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:35.047156 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-5b2b6df0-944c-4ee5-9f98-477f918c5553 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:35.200386 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-5b2b6df0-944c-4ee5-9f98-477f918c5553 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:35.209904 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-5b2b6df0-944c-4ee5-9f98-477f918c5553 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1265 microversion: 2.1 time: 0.184731 Aug 08 13:55:35.210490 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 571/1148] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:35 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:35.983719 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-c91b42ef-6dc0-4877-bc35-580c2108abaa req-de47afe9-cfc2-44cf-9fbd-ae532ea2801d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f783cd-858b-4a44-8d99-1f3376aa9991", "name": "network-vif-plugged", "status": "completed", "tag": "7e3cbe2c-db7e-4f08-89c4-aa71609b9691"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:55:35.989341 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=2 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:55:35.990085 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell0:SELECT=6 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:55:35.997887 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-c91b42ef-6dc0-4877-bc35-580c2108abaa req-de47afe9-cfc2-44cf-9fbd-ae532ea2801d service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:35.997887 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-c91b42ef-6dc0-4877-bc35-580c2108abaa req-de47afe9-cfc2-44cf-9fbd-ae532ea2801d service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:35.998373 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-c91b42ef-6dc0-4877-bc35-580c2108abaa req-de47afe9-cfc2-44cf-9fbd-ae532ea2801d service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:36.010503 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-c91b42ef-6dc0-4877-bc35-580c2108abaa req-de47afe9-cfc2-44cf-9fbd-ae532ea2801d service nova] Creating event network-vif-plugged:7e3cbe2c-db7e-4f08-89c4-aa71609b9691 for instance e1f783cd-858b-4a44-8d99-1f3376aa9991 on hv-cinder-85199 Aug 08 13:55:36.015689 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-c91b42ef-6dc0-4877-bc35-580c2108abaa req-de47afe9-cfc2-44cf-9fbd-ae532ea2801d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035758 Aug 08 13:55:36.016710 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 578/1149] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:55:36.231914 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-d86f568a-c2d9-4a67-b2cb-530e238fb479 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:36.232621 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-d86f568a-c2d9-4a67-b2cb-530e238fb479 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:36.239979 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d86f568a-c2d9-4a67-b2cb-530e238fb479 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:36.240463 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d86f568a-c2d9-4a67-b2cb-530e238fb479 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:36.240892 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d86f568a-c2d9-4a67-b2cb-530e238fb479 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:36.241588 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d86f568a-c2d9-4a67-b2cb-530e238fb479 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:36.242025 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d86f568a-c2d9-4a67-b2cb-530e238fb479 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:36.242474 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-d86f568a-c2d9-4a67-b2cb-530e238fb479 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:36.298475 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell0:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:55:36.422312 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-d86f568a-c2d9-4a67-b2cb-530e238fb479 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:36.430596 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-d86f568a-c2d9-4a67-b2cb-530e238fb479 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1265 microversion: 2.1 time: 0.202902 Aug 08 13:55:36.431163 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 572/1150] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:36 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:37.454237 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-febbba65-2686-4a19-86b7-e4843c21ed25 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:37.454933 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-febbba65-2686-4a19-86b7-e4843c21ed25 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:37.462061 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-febbba65-2686-4a19-86b7-e4843c21ed25 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:37.462557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-febbba65-2686-4a19-86b7-e4843c21ed25 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:37.462976 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-febbba65-2686-4a19-86b7-e4843c21ed25 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:37.463699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-febbba65-2686-4a19-86b7-e4843c21ed25 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:37.464127 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-febbba65-2686-4a19-86b7-e4843c21ed25 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:37.464557 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-febbba65-2686-4a19-86b7-e4843c21ed25 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:37.634247 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-febbba65-2686-4a19-86b7-e4843c21ed25 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:37.642687 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-febbba65-2686-4a19-86b7-e4843c21ed25 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1265 microversion: 2.1 time: 0.192744 Aug 08 13:55:37.643166 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 579/1151] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:37 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:38.663888 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-4eb20f5c-d394-4b89-a443-a546a61ec38f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:38.664522 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-4eb20f5c-d394-4b89-a443-a546a61ec38f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:38.671730 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4eb20f5c-d394-4b89-a443-a546a61ec38f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:38.672215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4eb20f5c-d394-4b89-a443-a546a61ec38f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:38.672651 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4eb20f5c-d394-4b89-a443-a546a61ec38f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:38.673368 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4eb20f5c-d394-4b89-a443-a546a61ec38f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:38.673817 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4eb20f5c-d394-4b89-a443-a546a61ec38f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:38.674237 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-4eb20f5c-d394-4b89-a443-a546a61ec38f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:38.811389 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-4eb20f5c-d394-4b89-a443-a546a61ec38f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:38.819048 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-4eb20f5c-d394-4b89-a443-a546a61ec38f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1452 microversion: 2.1 time: 0.159236 Aug 08 13:55:38.819644 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 573/1152] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:38 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:38.839225 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-fe4c95cd-5784-4f54-b744-befcd75c165e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:55:38.839815 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-fe4c95cd-5784-4f54-b744-befcd75c165e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:55:38.846861 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe4c95cd-5784-4f54-b744-befcd75c165e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:38.847365 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe4c95cd-5784-4f54-b744-befcd75c165e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:38.847895 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe4c95cd-5784-4f54-b744-befcd75c165e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:38.848579 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe4c95cd-5784-4f54-b744-befcd75c165e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:38.849019 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe4c95cd-5784-4f54-b744-befcd75c165e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:38.849431 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-fe4c95cd-5784-4f54-b744-befcd75c165e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:38.980258 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-fe4c95cd-5784-4f54-b744-befcd75c165e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:55:38.990175 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-fe4c95cd-5784-4f54-b744-befcd75c165e tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1452 microversion: 2.1 time: 0.154929 Aug 08 13:55:38.990955 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 580/1153] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:55:38 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:55:40.827913 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-6bba6a08-ae9c-41de-8833-ea14ac491e04 req-83de1dc7-50c2-4dc7-a723-b746f2d3a0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f783cd-858b-4a44-8d99-1f3376aa9991", "tag": "7e3cbe2c-db7e-4f08-89c4-aa71609b9691"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:55:40.837434 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-6bba6a08-ae9c-41de-8833-ea14ac491e04 req-83de1dc7-50c2-4dc7-a723-b746f2d3a0e9 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:55:40.837906 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-6bba6a08-ae9c-41de-8833-ea14ac491e04 req-83de1dc7-50c2-4dc7-a723-b746f2d3a0e9 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:55:40.838327 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-6bba6a08-ae9c-41de-8833-ea14ac491e04 req-83de1dc7-50c2-4dc7-a723-b746f2d3a0e9 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:55:40.849703 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-6bba6a08-ae9c-41de-8833-ea14ac491e04 req-83de1dc7-50c2-4dc7-a723-b746f2d3a0e9 service nova] Creating event network-changed:7e3cbe2c-db7e-4f08-89c4-aa71609b9691 for instance e1f783cd-858b-4a44-8d99-1f3376aa9991 on hv-cinder-85199 Aug 08 13:55:40.854783 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-6bba6a08-ae9c-41de-8833-ea14ac491e04 req-83de1dc7-50c2-4dc7-a723-b746f2d3a0e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227773 Aug 08 13:55:40.855428 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 574/1154] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:57:31.857175 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:57:31.858512 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG dbcounter [-] [124408] Writing DB stats nova_cell1:SELECT=64 {{(pid=124408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:57:31.860342 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:57:31.861060 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG dbcounter [-] [124407] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 13:57:31.862526 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-386b014e-e9c5-44bc-a7f8-4b6866232d0f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:31.863136 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-386b014e-e9c5-44bc-a7f8-4b6866232d0f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:31.865881 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [req-0c8e45f2-978d-4cfa-8a1f-11820cb7421c req-4c7ff6f5-d323-4f98-8f3e-d9ed086c35a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f783cd-858b-4a44-8d99-1f3376aa9991", "tag": "7e3cbe2c-db7e-4f08-89c4-aa71609b9691"}]} {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:57:31.870931 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386b014e-e9c5-44bc-a7f8-4b6866232d0f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:31.871499 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386b014e-e9c5-44bc-a7f8-4b6866232d0f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:31.872018 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386b014e-e9c5-44bc-a7f8-4b6866232d0f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:31.872757 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386b014e-e9c5-44bc-a7f8-4b6866232d0f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:31.873266 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386b014e-e9c5-44bc-a7f8-4b6866232d0f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:31.874054 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-386b014e-e9c5-44bc-a7f8-4b6866232d0f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:31.880210 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-0c8e45f2-978d-4cfa-8a1f-11820cb7421c req-4c7ff6f5-d323-4f98-8f3e-d9ed086c35a9 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:31.880712 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-0c8e45f2-978d-4cfa-8a1f-11820cb7421c req-4c7ff6f5-d323-4f98-8f3e-d9ed086c35a9 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:31.881215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [req-0c8e45f2-978d-4cfa-8a1f-11820cb7421c req-4c7ff6f5-d323-4f98-8f3e-d9ed086c35a9 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:31.895132 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.compute.server_external_events [req-0c8e45f2-978d-4cfa-8a1f-11820cb7421c req-4c7ff6f5-d323-4f98-8f3e-d9ed086c35a9 service nova] Creating event network-changed:7e3cbe2c-db7e-4f08-89c4-aa71609b9691 for instance e1f783cd-858b-4a44-8d99-1f3376aa9991 on hv-cinder-85199 Aug 08 13:57:31.900685 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [req-0c8e45f2-978d-4cfa-8a1f-11820cb7421c req-4c7ff6f5-d323-4f98-8f3e-d9ed086c35a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042494 Aug 08 13:57:31.901506 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 575/1155] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:57:31.901646 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-386b014e-e9c5-44bc-a7f8-4b6866232d0f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Going to try to terminate instance {{(pid=124408) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:57:31.983558 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-386b014e-e9c5-44bc-a7f8-4b6866232d0f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 204 len: 0 microversion: 2.1 time: 0.127626 Aug 08 13:57:31.985191 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 581/1156] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:57:31 2022] DELETE /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:57:31.994311 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-b71056b0-37b6-438a-a304-10181cd18078 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:31.995191 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-b71056b0-37b6-438a-a304-10181cd18078 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:32.001638 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71056b0-37b6-438a-a304-10181cd18078 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:32.002210 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71056b0-37b6-438a-a304-10181cd18078 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:32.002709 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71056b0-37b6-438a-a304-10181cd18078 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:32.003509 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71056b0-37b6-438a-a304-10181cd18078 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:32.004018 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71056b0-37b6-438a-a304-10181cd18078 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:32.004631 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-b71056b0-37b6-438a-a304-10181cd18078 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:32.142079 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-b71056b0-37b6-438a-a304-10181cd18078 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:57:32.149627 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-b71056b0-37b6-438a-a304-10181cd18078 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1576 microversion: 2.1 time: 0.160271 Aug 08 13:57:32.150200 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 576/1157] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:57:31 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 13:57:33.172984 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-ab5d468e-c32c-4328-8307-c5c40e7a290a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:33.173698 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-ab5d468e-c32c-4328-8307-c5c40e7a290a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:33.180478 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab5d468e-c32c-4328-8307-c5c40e7a290a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:33.180959 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab5d468e-c32c-4328-8307-c5c40e7a290a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:33.181386 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab5d468e-c32c-4328-8307-c5c40e7a290a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:33.182084 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab5d468e-c32c-4328-8307-c5c40e7a290a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:33.182527 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab5d468e-c32c-4328-8307-c5c40e7a290a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:33.182942 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-ab5d468e-c32c-4328-8307-c5c40e7a290a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:33.353982 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-ab5d468e-c32c-4328-8307-c5c40e7a290a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:57:33.362208 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-ab5d468e-c32c-4328-8307-c5c40e7a290a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1576 microversion: 2.1 time: 0.193508 Aug 08 13:57:33.362777 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 582/1158] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:57:33 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:57:34.388674 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-a23a2acc-f633-41d3-8b3a-86379a8bd11d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:34.389111 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-a23a2acc-f633-41d3-8b3a-86379a8bd11d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:34.400449 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a23a2acc-f633-41d3-8b3a-86379a8bd11d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:34.400936 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a23a2acc-f633-41d3-8b3a-86379a8bd11d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:34.401373 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a23a2acc-f633-41d3-8b3a-86379a8bd11d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:34.402225 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a23a2acc-f633-41d3-8b3a-86379a8bd11d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:34.402840 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a23a2acc-f633-41d3-8b3a-86379a8bd11d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:34.403292 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-a23a2acc-f633-41d3-8b3a-86379a8bd11d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:34.499045 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-a23a2acc-f633-41d3-8b3a-86379a8bd11d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:57:34.516907 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-a23a2acc-f633-41d3-8b3a-86379a8bd11d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1391 microversion: 2.1 time: 0.136579 Aug 08 13:57:34.517556 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 577/1159] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:57:34 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1391 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:57:34.561756 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-100d9d70-05b5-44de-a749-18f3db8a7b13 req-af494c9f-5e6b-4805-9cd6-dafa38cb82f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f783cd-858b-4a44-8d99-1f3376aa9991", "name": "network-vif-deleted", "tag": "7e3cbe2c-db7e-4f08-89c4-aa71609b9691"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:57:34.571782 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-100d9d70-05b5-44de-a749-18f3db8a7b13 req-af494c9f-5e6b-4805-9cd6-dafa38cb82f0 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:34.572560 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-100d9d70-05b5-44de-a749-18f3db8a7b13 req-af494c9f-5e6b-4805-9cd6-dafa38cb82f0 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:34.573172 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-100d9d70-05b5-44de-a749-18f3db8a7b13 req-af494c9f-5e6b-4805-9cd6-dafa38cb82f0 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:34.584546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-100d9d70-05b5-44de-a749-18f3db8a7b13 req-af494c9f-5e6b-4805-9cd6-dafa38cb82f0 service nova] Creating event network-vif-deleted:7e3cbe2c-db7e-4f08-89c4-aa71609b9691 for instance e1f783cd-858b-4a44-8d99-1f3376aa9991 on hv-cinder-85199 Aug 08 13:57:34.590125 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-100d9d70-05b5-44de-a749-18f3db8a7b13 req-af494c9f-5e6b-4805-9cd6-dafa38cb82f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031736 Aug 08 13:57:34.590645 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 583/1160] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:57:35.539583 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:35.540241 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:35.547122 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:35.547635 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:35.548066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:35.548763 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:35.549213 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:35.549636 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:35.583485 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:35.583966 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:35.584394 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:35.584832 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.objects.instance [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lazy-loading 'fault' on Instance uuid e1f783cd-858b-4a44-8d99-1f3376aa9991 {{(pid=124407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 13:57:35.628310 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:57:35.636020 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-f42f93f3-4118-443f-8635-6d3ec02301ee tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 200 len: 1230 microversion: 2.1 time: 0.100458 Aug 08 13:57:35.636792 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 578/1161] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:57:35 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:57:36.661635 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:36.662771 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: e1f783cd-858b-4a44-8d99-1f3376aa9991] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:36.673952 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:36.674746 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:36.675537 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:36.676687 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:36.677440 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:36.678156 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:36.693071 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] HTTP exception thrown: Instance e1f783cd-858b-4a44-8d99-1f3376aa9991 could not be found. Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Request method failure captured: Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 HTTP/1.1 Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8RSBldsahuh_IebB5myptj3S3gjnxXbqOVowi6_K08ZOYhcVHmln13j_BwrVO1d4NjUejFvb6JJLIjPVLOpS-hvfT0vE5-4i98fPpPSm1IajR0gvfQyoKoqR8lKPgQk0_aWV8IB9nn7pQ2LgjnfKDGskTgAJri2JWGUryvsXSwxWtz8 Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: a019b128831a47b7996b3d3e9d6e5652 Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:57:36.694679 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a019b128831a47b7996b3d3e9d6e5652"}]}] Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: a019b128831a47b7996b3d3e9d6e5652 Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-TestVolumeBootPattern-1874176799-project Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: d4bb35df2ffd48bf965425afcdbc42fd Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-TestVolumeBootPattern-1874176799-project Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance e1f783cd-858b-4a44-8d99-1f3376aa9991 could not be found. Aug 08 13:57:36.696638 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': 'e1f783cd-858b-4a44-8d99-1f3376aa9991'} Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f783cd-858b-4a44-8d99-1f3376aa9991 could not be found. Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:57:36.697520 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f783cd-858b-4a44-8d99-1f3376aa9991 could not be found. Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f783cd-858b-4a44-8d99-1f3376aa9991 could not be found. Aug 08 13:57:36.699014 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:36.700329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Returning 404 to user: Instance e1f783cd-858b-4a44-8d99-1f3376aa9991 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:57:36.700329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-5e88e451-bf29-4933-9777-309f69bcaedb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991" status: 404 len: 111 microversion: 2.1 time: 0.041435 Aug 08 13:57:36.700329 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 584/1162] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:57:36 2022] GET /compute/v2.1/servers/e1f783cd-858b-4a44-8d99-1f3376aa9991 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:57:40.057941 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-1c47ca5b-0564-403d-b476-29c206f4a809 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:40.058714 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1c47ca5b-0564-403d-b476-29c206f4a809 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:40.059764 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-fbe37f09-7dbf-43b0-80d0-9497f66b25b1 req-11bd2a44-6ac7-4162-bb37-a9bdeeda7d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7def083-1d61-4a2f-8e5e-0917c10131f0", "tag": "2475f52a-b4ef-4864-894d-dcaec5267299"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:57:40.065174 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c47ca5b-0564-403d-b476-29c206f4a809 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:40.065726 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c47ca5b-0564-403d-b476-29c206f4a809 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:40.066215 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c47ca5b-0564-403d-b476-29c206f4a809 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:40.067007 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c47ca5b-0564-403d-b476-29c206f4a809 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:40.067511 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c47ca5b-0564-403d-b476-29c206f4a809 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:40.067991 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-1c47ca5b-0564-403d-b476-29c206f4a809 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:40.069973 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-fbe37f09-7dbf-43b0-80d0-9497f66b25b1 req-11bd2a44-6ac7-4162-bb37-a9bdeeda7d11 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:40.070444 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-fbe37f09-7dbf-43b0-80d0-9497f66b25b1 req-11bd2a44-6ac7-4162-bb37-a9bdeeda7d11 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:40.071048 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-fbe37f09-7dbf-43b0-80d0-9497f66b25b1 req-11bd2a44-6ac7-4162-bb37-a9bdeeda7d11 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:40.082926 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-fbe37f09-7dbf-43b0-80d0-9497f66b25b1 req-11bd2a44-6ac7-4162-bb37-a9bdeeda7d11 service nova] Creating event network-changed:2475f52a-b4ef-4864-894d-dcaec5267299 for instance a7def083-1d61-4a2f-8e5e-0917c10131f0 on hv-cinder-85199 Aug 08 13:57:40.088135 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-fbe37f09-7dbf-43b0-80d0-9497f66b25b1 req-11bd2a44-6ac7-4162-bb37-a9bdeeda7d11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032147 Aug 08 13:57:40.089179 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 585/1163] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:57:40.097405 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-1c47ca5b-0564-403d-b476-29c206f4a809 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Going to try to terminate instance {{(pid=124407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 13:57:40.186337 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-1c47ca5b-0564-403d-b476-29c206f4a809 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 204 len: 0 microversion: 2.1 time: 0.131713 Aug 08 13:57:40.189383 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 579/1164] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:57:40 2022] DELETE /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 13:57:40.199615 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-9a3216d7-0325-4d2c-b77b-9a7b8415fee0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:40.200344 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-9a3216d7-0325-4d2c-b77b-9a7b8415fee0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:40.208883 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9a3216d7-0325-4d2c-b77b-9a7b8415fee0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:40.212151 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9a3216d7-0325-4d2c-b77b-9a7b8415fee0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:40.212517 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9a3216d7-0325-4d2c-b77b-9a7b8415fee0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:40.213294 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9a3216d7-0325-4d2c-b77b-9a7b8415fee0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:40.213776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9a3216d7-0325-4d2c-b77b-9a7b8415fee0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:40.214219 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-9a3216d7-0325-4d2c-b77b-9a7b8415fee0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:40.351776 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.policy [None req-9a3216d7-0325-4d2c-b77b-9a7b8415fee0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:57:40.359691 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-9a3216d7-0325-4d2c-b77b-9a7b8415fee0 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1576 microversion: 2.1 time: 0.164492 Aug 08 13:57:40.360294 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 586/1165] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:57:40 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:57:41.382036 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-e572b66a-9a74-4378-8418-24bd4c4f8d0d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:41.382809 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-e572b66a-9a74-4378-8418-24bd4c4f8d0d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:41.389612 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e572b66a-9a74-4378-8418-24bd4c4f8d0d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:41.390097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e572b66a-9a74-4378-8418-24bd4c4f8d0d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:41.390521 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e572b66a-9a74-4378-8418-24bd4c4f8d0d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:41.391233 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e572b66a-9a74-4378-8418-24bd4c4f8d0d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:41.391682 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e572b66a-9a74-4378-8418-24bd4c4f8d0d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:41.392097 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-e572b66a-9a74-4378-8418-24bd4c4f8d0d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:41.562160 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-e572b66a-9a74-4378-8418-24bd4c4f8d0d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:57:41.569873 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-e572b66a-9a74-4378-8418-24bd4c4f8d0d tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1576 microversion: 2.1 time: 0.192344 Aug 08 13:57:41.570432 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 580/1166] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:57:41 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:57:42.429885 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [req-c0cd0b6a-01b8-40af-be94-4e8f0eaf7c39 req-0683059b-aca8-45a7-a6af-ddb400044503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7def083-1d61-4a2f-8e5e-0917c10131f0", "name": "network-vif-deleted", "tag": "2475f52a-b4ef-4864-894d-dcaec5267299"}]} {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 13:57:42.440203 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-c0cd0b6a-01b8-40af-be94-4e8f0eaf7c39 req-0683059b-aca8-45a7-a6af-ddb400044503 service nova] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:42.440674 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-c0cd0b6a-01b8-40af-be94-4e8f0eaf7c39 req-0683059b-aca8-45a7-a6af-ddb400044503 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:42.441109 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [req-c0cd0b6a-01b8-40af-be94-4e8f0eaf7c39 req-0683059b-aca8-45a7-a6af-ddb400044503 service nova] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:42.452597 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.compute.server_external_events [req-c0cd0b6a-01b8-40af-be94-4e8f0eaf7c39 req-0683059b-aca8-45a7-a6af-ddb400044503 service nova] Creating event network-vif-deleted:2475f52a-b4ef-4864-894d-dcaec5267299 for instance a7def083-1d61-4a2f-8e5e-0917c10131f0 on hv-cinder-85199 Aug 08 13:57:42.457546 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [req-c0cd0b6a-01b8-40af-be94-4e8f0eaf7c39 req-0683059b-aca8-45a7-a6af-ddb400044503 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031348 Aug 08 13:57:42.458149 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 587/1167] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 13:57:42.592065 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-125cdb36-0247-474a-803f-6d561bd46a98 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:42.592634 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-125cdb36-0247-474a-803f-6d561bd46a98 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:42.599222 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-125cdb36-0247-474a-803f-6d561bd46a98 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:42.599705 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-125cdb36-0247-474a-803f-6d561bd46a98 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:42.600135 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-125cdb36-0247-474a-803f-6d561bd46a98 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:42.600824 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-125cdb36-0247-474a-803f-6d561bd46a98 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:42.601272 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-125cdb36-0247-474a-803f-6d561bd46a98 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:42.601713 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-125cdb36-0247-474a-803f-6d561bd46a98 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:42.663476 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.policy [None req-125cdb36-0247-474a-803f-6d561bd46a98 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4bb35df2ffd48bf965425afcdbc42fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019b128831a47b7996b3d3e9d6e5652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 13:57:42.671392 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-125cdb36-0247-474a-803f-6d561bd46a98 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 200 len: 1225 microversion: 2.1 time: 0.083667 Aug 08 13:57:42.671958 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 581/1168] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:57:42 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 13:57:43.697335 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:43.698576 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: a7def083-1d61-4a2f-8e5e-0917c10131f0] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:43.705206 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:43.705680 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:43.706106 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:43.706792 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:43.707275 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:43.707725 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:43.721703 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] HTTP exception thrown: Instance a7def083-1d61-4a2f-8e5e-0917c10131f0 could not be found. Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Request method failure captured: Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 HTTP/1.1 Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8RSBldsahuh_IebB5myptj3S3gjnxXbqOVowi6_K08ZOYhcVHmln13j_BwrVO1d4NjUejFvb6JJLIjPVLOpS-hvfT0vE5-4i98fPpPSm1IajR0gvfQyoKoqR8lKPgQk0_aWV8IB9nn7pQ2LgjnfKDGskTgAJri2JWGUryvsXSwxWtz8 Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: a019b128831a47b7996b3d3e9d6e5652 Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:57:43.723351 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a019b128831a47b7996b3d3e9d6e5652"}]}] Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: a019b128831a47b7996b3d3e9d6e5652 Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-TestVolumeBootPattern-1874176799-project Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: d4bb35df2ffd48bf965425afcdbc42fd Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-TestVolumeBootPattern-1874176799-project Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance a7def083-1d61-4a2f-8e5e-0917c10131f0 could not be found. Aug 08 13:57:43.724875 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': 'a7def083-1d61-4a2f-8e5e-0917c10131f0'} Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7def083-1d61-4a2f-8e5e-0917c10131f0 could not be found. Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:57:43.725699 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7def083-1d61-4a2f-8e5e-0917c10131f0 could not be found. Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7def083-1d61-4a2f-8e5e-0917c10131f0 could not be found. Aug 08 13:57:43.727477 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:43.729123 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Returning 404 to user: Instance a7def083-1d61-4a2f-8e5e-0917c10131f0 could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:57:43.729123 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-bc250cac-7ac6-45ec-8c3b-d4a5edd1404a tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0" status: 404 len: 111 microversion: 2.1 time: 0.035165 Aug 08 13:57:43.729123 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 588/1169] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:57:43 2022] GET /compute/v2.1/servers/a7def083-1d61-4a2f-8e5e-0917c10131f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:57:44.180802 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:44.181330 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.compute.api [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:44.188066 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:44.188548 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:44.188983 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:44.189681 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:44.190134 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:44.190557 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG oslo_concurrency.lockutils [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:44.203927 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.wsgi [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] HTTP exception thrown: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Request method failure captured: Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: request: DELETE /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc HTTP/1.1 Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept: application/json Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Accept-Encoding: identity Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Connection: close Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Length: 0 Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Content-Type: application/json Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Host: 10.222.0.33 Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Openstack-System-Scope: None Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: User-Agent: python-urllib3/1.26.11 Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Auth-Token: gAAAAABi8RSBldsahuh_IebB5myptj3S3gjnxXbqOVowi6_K08ZOYhcVHmln13j_BwrVO1d4NjUejFvb6JJLIjPVLOpS-hvfT0vE5-4i98fPpPSm1IajR0gvfQyoKoqR8lKPgQk0_aWV8IB9nn7pQ2LgjnfKDGskTgAJri2JWGUryvsXSwxWtz8 Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Id: None Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Domain-Name: None Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Identity-Status: Confirmed Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Is-Admin-Project: True Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Id: default Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Domain-Name: Default Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Id: a019b128831a47b7996b3d3e9d6e5652 Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Project-Name: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Role: reader,member Aug 08 13:57:44.205604 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Roles: reader,member Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a019b128831a47b7996b3d3e9d6e5652"}]}] Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Id: a019b128831a47b7996b3d3e9d6e5652 Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User: tempest-TestVolumeBootPattern-1874176799-project Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Id: default Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Domain-Name: Default Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Id: d4bb35df2ffd48bf965425afcdbc42fd Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: X-User-Name: tempest-TestVolumeBootPattern-1874176799-project Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: method: > Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: exception: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:57:44.207400 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: action_args: {'id': '0608a48e-ce46-4bfa-8ee2-e59a1e6415cc'} Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:57:44.208440 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:57:44.210009 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: ERROR nova.api.openstack.wsgi Aug 08 13:57:44.211682 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Returning 404 to user: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. {{(pid=124407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:57:44.211682 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-0cc37aab-dbc5-4213-ad8d-6b446d259966 tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 404 len: 111 microversion: 2.1 time: 0.030235 Aug 08 13:57:44.211682 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 582/1170] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 13:57:44 2022] DELETE /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:57:44.216437 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '>' {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:44.217075 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.compute.api [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] [instance: 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc] Fetching instance by UUID {{(pid=124408) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 13:57:44.223261 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:44.223773 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:44.224205 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:44.224895 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Acquiring lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 13:57:44.225344 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 13:57:44.225784 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG oslo_concurrency.lockutils [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Lock "0ff79e92-6cf9-4dd3-a90b-48ee0ea308c1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 13:57:44.239601 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.wsgi [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] HTTP exception thrown: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Request method failure captured: Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: request: GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc HTTP/1.1 Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept: application/json Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Accept-Encoding: identity Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Connection: close Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Length: 0 Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Content-Type: application/json Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Host: 10.222.0.33 Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Openstack-System-Scope: None Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: User-Agent: python-urllib3/1.26.11 Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Auth-Token: gAAAAABi8RSBldsahuh_IebB5myptj3S3gjnxXbqOVowi6_K08ZOYhcVHmln13j_BwrVO1d4NjUejFvb6JJLIjPVLOpS-hvfT0vE5-4i98fPpPSm1IajR0gvfQyoKoqR8lKPgQk0_aWV8IB9nn7pQ2LgjnfKDGskTgAJri2JWGUryvsXSwxWtz8 Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Id: None Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Domain-Name: None Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Identity-Status: Confirmed Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Is-Admin-Project: True Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Id: default Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Domain-Name: Default Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Id: a019b128831a47b7996b3d3e9d6e5652 Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Project-Name: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Role: reader,member Aug 08 13:57:44.241152 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Roles: reader,member Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a019b128831a47b7996b3d3e9d6e5652"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a019b128831a47b7996b3d3e9d6e5652"}]}] Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Id: a019b128831a47b7996b3d3e9d6e5652 Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-Tenant-Name: tempest-TestVolumeBootPattern-1874176799 Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User: tempest-TestVolumeBootPattern-1874176799-project Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Id: default Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Domain-Name: Default Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Id: d4bb35df2ffd48bf965425afcdbc42fd Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: X-User-Name: tempest-TestVolumeBootPattern-1874176799-project Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: method: > Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: exception: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:57:44.242796 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: action_args: {'id': '0608a48e-ce46-4bfa-8ee2-e59a1e6415cc'} Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: {{(pid=124408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 13:57:44.243865 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. Aug 08 13:57:44.245494 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: ERROR nova.api.openstack.wsgi Aug 08 13:57:44.246933 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: DEBUG nova.api.openstack.wsgi [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Returning 404 to user: Instance 0608a48e-ce46-4bfa-8ee2-e59a1e6415cc could not be found. {{(pid=124408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 13:57:44.246933 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO nova.api.openstack.requestlog [None req-6e2ae42f-9498-4f15-88d0-7f46b792ae7f tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc" status: 404 len: 111 microversion: 2.1 time: 0.030577 Aug 08 13:57:44.246933 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: [pid: 124408|app: 0|req: 589/1171] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 13:57:44 2022] GET /compute/v2.1/servers/0608a48e-ce46-4bfa-8ee2-e59a1e6415cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 13:57:45.560254 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: DEBUG nova.api.openstack.wsgi [None req-13402bca-cc24-4a44-84bf-fc035b9877cb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] Calling method '.version_select at 0x7f7d245d4700>' {{(pid=124407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 13:57:45.592121 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO nova.api.openstack.requestlog [None req-13402bca-cc24-4a44-84bf-fc035b9877cb tempest-TestVolumeBootPattern-1874176799 tempest-TestVolumeBootPattern-1874176799-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1648947255" status: 202 len: 0 microversion: 2.1 time: 0.035725 Aug 08 13:57:45.592721 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: [pid: 124407|app: 0|req: 583/1172] 10.222.0.33 () {58 vars in 1263 bytes} [Mon Aug 8 13:57:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1648947255 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 13:57:54.258387 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 08 13:57:54.259012 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Mon Aug 8 13:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 13:58:02.567523 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 13:58:02.568484 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Mon Aug 8 13:58:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 13:58:06.611906 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 13:58:06.611906 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Mon Aug 8 13:58:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:00:24.211808 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:00:24.212980 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Mon Aug 8 14:00:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:00:41.114298 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:00:41.115223 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Mon Aug 8 14:00:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:00:52.612099 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:00:52.612960 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Mon Aug 8 14:00:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:02:54.267889 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:02:54.268882 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Mon Aug 8 14:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:03:02.580224 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:03:02.581650 dv-cinder-851996-6-iscsi devstack@n-api.service[124408]: Mon Aug 8 14:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 14:03:06.626148 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 14:03:06.627055 dv-cinder-851996-6-iscsi devstack@n-api.service[124407]: Mon Aug 8 14:03:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!